CNN Classification without Data Augmentation¶
Image Classification¶
In this project, you'll classify images from the CIFAR-10 dataset. The dataset consists of airplanes, dogs, cats, and other objects. You'll preprocess the images, then train a convolutional neural network on all the samples. The images need to be normalized and the labels need to be one-hot encoded. You'll get to apply what you learned and build a convolutional, max pooling, dropout, and fully connected layers. At the end, you'll get to see your neural network's predictions on the sample images.
Load nessecerry modules¶
In [1]:
!pip install tqdm
Requirement already satisfied: tqdm in c:\users\gpu\anaconda3\lib\site-packages
You are using pip version 9.0.3, however version 10.0.1 is available. You should consider upgrading via the 'python -m pip install --upgrade pip' command.
In [2]:
import os, tarfile, random, pickle
from unittest.mock import MagicMock
from urllib.request import urlretrieve
from os.path import isfile, isdir
from tqdm import tqdm
import numpy as np
import tensorflow as tf
import matplotlib.pyplot as plt
from sklearn.preprocessing import LabelBinarizer
In [3]:
def _load_label_names():
"""
Load the label names from file
"""
return ['airplane', 'automobile', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']
def load_cfar10_batch(cifar10_dataset_folder_path, batch_id):
"""
Load a batch of the dataset
"""
with open(cifar10_dataset_folder_path + '/data_batch_' + str(batch_id), mode='rb') as file:
batch = pickle.load(file, encoding='latin1')
features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
labels = batch['labels']
return features, labels
def display_stats(cifar10_dataset_folder_path, batch_id, sample_id):
"""
Display Stats of the the dataset
"""
batch_ids = list(range(1, 6))
if batch_id not in batch_ids:
print('Batch Id out of Range. Possible Batch Ids: {}'.format(batch_ids))
return None
features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_id)
if not (0 <= sample_id < len(features)):
print('{} samples in batch {}. {} is out of range.'.format(len(features), batch_id, sample_id))
return None
print('\nStats of batch {}:'.format(batch_id))
print('Samples: {}'.format(len(features)))
print('Label Counts: {}'.format(dict(zip(*np.unique(labels, return_counts=True)))))
print('First 20 Labels: {}'.format(labels[:20]))
sample_image = features[sample_id]
sample_label = labels[sample_id]
label_names = _load_label_names()
print('\nExample of Image {}:'.format(sample_id))
print('Image - Min Value: {} Max Value: {}'.format(sample_image.min(), sample_image.max()))
print('Image - Shape: {}'.format(sample_image.shape))
print('Label - Label Id: {} Name: {}'.format(sample_label, label_names[sample_label]))
plt.axis('off')
plt.imshow(sample_image)
def _preprocess_and_save(normalize, one_hot_encode, features, labels, filename):
"""
Preprocess data and save it to file
"""
features = normalize(features)
labels = one_hot_encode(labels)
pickle.dump((features, labels), open(filename, 'wb'))
def preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode):
"""
Preprocess Training and Validation Data
"""
n_batches = 5
valid_features = []
valid_labels = []
for batch_i in range(1, n_batches + 1):
features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_i)
#indices = np.arange(features.shape[0])
#np.random.shuffle(indices)
#features = features[indices]
#labels = np.array(labels)[indices].tolist()
validation_count = int(len(features) * 0.1)
# Prprocess and save a batch of training data
_preprocess_and_save(
normalize,
one_hot_encode,
features[:-validation_count],
labels[:-validation_count],
'preprocess_batch_' + str(batch_i) + '.p')
# Use a portion of training batch for validation
valid_features.extend(features[-validation_count:])
valid_labels.extend(labels[-validation_count:])
# Preprocess and Save all validation data
_preprocess_and_save(
normalize,
one_hot_encode,
np.array(valid_features),
np.array(valid_labels),
'preprocess_validation.p')
with open(cifar10_dataset_folder_path + '/test_batch', mode='rb') as file:
batch = pickle.load(file, encoding='latin1')
# load the test data
test_features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
test_labels = batch['labels']
# Preprocess and Save all test data
_preprocess_and_save(
normalize,
one_hot_encode,
np.array(test_features),
np.array(test_labels),
'preprocess_test.p')
def batch_features_labels(features, labels, batch_size):
"""
Split features and labels into batches
"""
for start in range(0, len(features), batch_size):
end = min(start + batch_size, len(features))
yield features[start:end], labels[start:end]
def load_preprocess_training_batch(batch_id, batch_size):
"""
Load the Preprocessed Training data and return them in batches of <batch_size> or less
"""
filename = 'preprocess_batch_' + str(batch_id) + '.p'
features, labels = pickle.load(open(filename, mode='rb'))
# Return the training data in batches of size <batch_size> or less
return batch_features_labels(features, labels, batch_size)
def display_image_predictions(features, labels, predictions):
n_classes = 10
label_names = _load_label_names()
label_binarizer = LabelBinarizer()
label_binarizer.fit(range(n_classes))
label_ids = label_binarizer.inverse_transform(np.array(labels))
fig, axies = plt.subplots(nrows=4, ncols=2)
fig.tight_layout()
fig.suptitle('Softmax Predictions', fontsize=20, y=1.1)
n_predictions = 3
margin = 0.05
ind = np.arange(n_predictions)
width = (1. - 2. * margin) / n_predictions
for image_i, (feature, label_id, pred_indicies, pred_values) in enumerate(zip(features, label_ids, predictions.indices, predictions.values)):
pred_names = [label_names[pred_i] for pred_i in pred_indicies]
correct_name = label_names[label_id]
axies[image_i][0].imshow(feature)
axies[image_i][0].set_title(correct_name)
axies[image_i][0].set_axis_off()
axies[image_i][1].barh(ind + margin, pred_values[::-1], width)
axies[image_i][1].set_yticks(ind + margin)
axies[image_i][1].set_yticklabels(pred_names[::-1])
axies[image_i][1].set_xticks([0, 0.5, 1.0])
In [4]:
def _print_success_message():
print('Tests Passed')
def test_folder_path(cifar10_dataset_folder_path):
assert cifar10_dataset_folder_path is not None,\
'Cifar-10 data folder not set.'
assert cifar10_dataset_folder_path[-1] != '/',\
'The "/" shouldn\'t be added to the end of the path.'
assert os.path.exists(cifar10_dataset_folder_path),\
'Path not found.'
assert os.path.isdir(cifar10_dataset_folder_path),\
'{} is not a folder.'.format(os.path.basename(cifar10_dataset_folder_path))
train_files = [cifar10_dataset_folder_path + '/data_batch_' + str(batch_id) for batch_id in range(1, 6)]
other_files = [cifar10_dataset_folder_path + '/batches.meta', cifar10_dataset_folder_path + '/test_batch']
missing_files = [path for path in train_files + other_files if not os.path.exists(path)]
assert not missing_files,\
'Missing files in directory: {}'.format(missing_files)
print('All files found!')
def test_normalize(normalize):
test_shape = (np.random.choice(range(1000)), 32, 32, 3)
test_numbers = np.random.choice(range(256), test_shape)
normalize_out = normalize(test_numbers)
assert type(normalize_out).__module__ == np.__name__,\
'Not Numpy Object'
assert normalize_out.shape == test_shape,\
'Incorrect Shape. {} shape found'.format(normalize_out.shape)
assert normalize_out.max() <= 1 and normalize_out.min() >= 0,\
'Incorect Range. {} to {} found'.format(normalize_out.min(), normalize_out.max())
_print_success_message()
def test_one_hot_encode(one_hot_encode):
test_shape = np.random.choice(range(1000))
test_numbers = np.random.choice(range(10), test_shape)
one_hot_out = one_hot_encode(test_numbers)
assert type(one_hot_out).__module__ == np.__name__,\
'Not Numpy Object'
assert one_hot_out.shape == (test_shape, 10),\
'Incorrect Shape. {} shape found'.format(one_hot_out.shape)
n_encode_tests = 5
test_pairs = list(zip(test_numbers, one_hot_out))
test_indices = np.random.choice(len(test_numbers), n_encode_tests)
labels = [test_pairs[test_i][0] for test_i in test_indices]
enc_labels = np.array([test_pairs[test_i][1] for test_i in test_indices])
new_enc_labels = one_hot_encode(labels)
assert np.array_equal(enc_labels, new_enc_labels),\
'Encodings returned different results for the same numbers.\n' \
'For the first call it returned:\n' \
'{}\n' \
'For the second call it returned\n' \
'{}\n' \
'Make sure you save the map of labels to encodings outside of the function.'.format(enc_labels, new_enc_labels)
_print_success_message()
def test_nn_image_inputs(neural_net_image_input):
image_shape = (32, 32, 3)
nn_inputs_out_x = neural_net_image_input(image_shape)
assert nn_inputs_out_x.get_shape().as_list() == [None, image_shape[0], image_shape[1], image_shape[2]],\
'Incorrect Image Shape. Found {} shape'.format(nn_inputs_out_x.get_shape().as_list())
assert nn_inputs_out_x.op.type == 'Placeholder',\
'Incorrect Image Type. Found {} type'.format(nn_inputs_out_x.op.type)
assert nn_inputs_out_x.name == 'x:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_x.name)
print('Image Input Tests Passed.')
def test_nn_label_inputs(neural_net_label_input):
n_classes = 10
nn_inputs_out_y = neural_net_label_input(n_classes)
assert nn_inputs_out_y.get_shape().as_list() == [None, n_classes],\
'Incorrect Label Shape. Found {} shape'.format(nn_inputs_out_y.get_shape().as_list())
assert nn_inputs_out_y.op.type == 'Placeholder',\
'Incorrect Label Type. Found {} type'.format(nn_inputs_out_y.op.type)
assert nn_inputs_out_y.name == 'y:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_y.name)
print('Label Input Tests Passed.')
def test_nn_keep_prob_inputs(neural_net_keep_prob_input):
nn_inputs_out_k = neural_net_keep_prob_input()
assert nn_inputs_out_k.get_shape().ndims is None,\
'Too many dimensions found for keep prob. Found {} dimensions. It should be a scalar (0-Dimension Tensor).'.format(nn_inputs_out_k.get_shape().ndims)
assert nn_inputs_out_k.op.type == 'Placeholder',\
'Incorrect keep prob Type. Found {} type'.format(nn_inputs_out_k.op.type)
assert nn_inputs_out_k.name == 'keep_prob:0', \
'Incorrect Name. Found {}'.format(nn_inputs_out_k.name)
print('Keep Prob Tests Passed.')
def test_con_pool(conv2d_maxpool):
test_x = tf.placeholder(tf.float32, [None, 32, 32, 5])
test_num_outputs = 10
test_con_k = (2, 2)
test_con_s = (4, 4)
test_pool_k = (2, 2)
test_pool_s = (2, 2)
conv2d_maxpool_out = conv2d_maxpool(test_x, test_num_outputs, test_con_k, test_con_s, test_pool_k, test_pool_s)
assert conv2d_maxpool_out.get_shape().as_list() == [None, 4, 4, 10],\
'Incorrect Shape. Found {} shape'.format(conv2d_maxpool_out.get_shape().as_list())
_print_success_message()
def test_flatten(flatten):
test_x = tf.placeholder(tf.float32, [None, 10, 30, 6])
flat_out = flatten(test_x)
assert flat_out.get_shape().as_list() == [None, 10*30*6],\
'Incorrect Shape. Found {} shape'.format(flat_out.get_shape().as_list())
_print_success_message()
def test_fully_conn(fully_conn):
test_x = tf.placeholder(tf.float32, [None, 128])
test_num_outputs = 40
fc_out = fully_conn(test_x, test_num_outputs)
assert fc_out.get_shape().as_list() == [None, 40],\
'Incorrect Shape. Found {} shape'.format(fc_out.get_shape().as_list())
_print_success_message()
def test_output(output):
test_x = tf.placeholder(tf.float32, [None, 128])
test_num_outputs = 40
output_out = output(test_x, test_num_outputs)
assert output_out.get_shape().as_list() == [None, 40],\
'Incorrect Shape. Found {} shape'.format(output_out.get_shape().as_list())
_print_success_message()
def test_conv_net(conv_net):
test_x = tf.placeholder(tf.float32, [None, 32, 32, 3])
test_k = tf.placeholder(tf.float32)
logits_out = conv_net(test_x, test_k)
assert logits_out.get_shape().as_list() == [None, 10],\
'Incorrect Model Output. Found {}'.format(logits_out.get_shape().as_list())
print('Neural Network Built!')
def test_train_nn(train_neural_network):
mock_session = tf.Session()
test_x = np.random.rand(128, 32, 32, 3)
test_y = np.random.rand(128, 10)
test_k = np.random.rand(1)
test_optimizer = tf.train.AdamOptimizer()
mock_session.run = MagicMock()
train_neural_network(mock_session, test_optimizer, test_k, test_x, test_y)
assert mock_session.run.called, 'Session not used'
_print_success_message()
Get the Data¶
Run the following cell to download the CIFAR-10 dataset for python.
In [5]:
cifar10_dataset_folder_path = 'cifar-10-batches-py'
class DLProgress(tqdm):
last_block = 0
def hook(self, block_num=1, block_size=1, total_size=None):
self.total = total_size
self.update((block_num - self.last_block) * block_size)
self.last_block = block_num
tar_gz_path = 'cifar-10-python.tar.gz'
if not isdir(cifar10_dataset_folder_path):
if not isfile(tar_gz_path):
with DLProgress(unit='B', unit_scale=True, miniters=1, desc='CIFAR-10 Dataset') as pbar:
urlretrieve(
'https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz',
tar_gz_path,
pbar.hook)
with tarfile.open(tar_gz_path) as tar:
tar.extractall()
tar.close()
test_folder_path(cifar10_dataset_folder_path)
All files found!
Explore the Data¶
The dataset is broken into batches to prevent your machine from running out of memory. The CIFAR-10 dataset consists of 5 batches, named data_batch_1, data_batch_2, etc.. Each batch contains the labels and images that are one of the following:
- airplane
- automobile
- bird
- cat
- deer
- dog
- frog
- horse
- ship
- truck
Understanding a dataset is part of making predictions on the data. Play around with the code cell below by changing the batch_id and sample_id. The batch_id is the id for a batch (1-5). The sample_id is the id for a image and label pair in the batch.
Ask yourself "What are all possible labels?", "What is the range of values for the image data?", "Are the labels in order or random?". Answers to questions like these will help you preprocess the data and end up with better predictions.
In [6]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
# Explore the dataset
batch_id = 1
sample_id = 6
display_stats(cifar10_dataset_folder_path, batch_id, sample_id)
Stats of batch 1:
Samples: 10000
Label Counts: {0: 1005, 1: 974, 2: 1032, 3: 1016, 4: 999, 5: 937, 6: 1030, 7: 1001, 8: 1025, 9: 981}
First 20 Labels: [6, 9, 9, 4, 1, 1, 2, 7, 8, 3, 4, 7, 7, 2, 9, 9, 9, 3, 2, 6]
Example of Image 6:
Image - Min Value: 7 Max Value: 249
Image - Shape: (32, 32, 3)
Label - Label Id: 2 Name: bird
In [7]:
def normalize(x):
"""
Normalize a list of sample image data in the range of 0 to 1
: x: List of image data. The image shape is (32, 32, 3)
: return: Numpy array of normalize data
"""
# TODO: Implement Function
norm = (x-x.min())/(x.max()-x.min())
return norm
One-hot encode¶
Just like the previous code cell, you'll be implementing a function for preprocessing. This time, you'll implement the one_hot_encode function. The input, x, are a list of labels. Implement the function to return the list of labels as One-Hot encoded Numpy array. The possible values for labels are 0 to 9. The one-hot encoding function should return the same encoding for each value between each call to one_hot_encode. Make sure to save the map of encodings outside the function.
Hint: Don't reinvent the wheel.
In [8]:
def one_hot_encode(x):
"""
One hot encode a list of sample labels. Return a one-hot encoded vector for each label.
: x: List of sample Labels
: return: Numpy array of one-hot encoded labels
"""
# TODO: Implement Function
encoding = np.eye(10)[x]
return encoding
Randomize Data¶
As you saw from exploring the data above, the order of the samples are randomized. It doesn't hurt to randomize it again, but you don't need to for this dataset.
Preprocess all the data and save it¶
Running the code cell below will preprocess all the CIFAR-10 data and save it to file. The code below also uses 10% of the training data for validation.
In [9]:
# Preprocess Training, Validation, and Testing Data
preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode)
Check Point¶
This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk.
In [10]:
# Load the Preprocessed Validation data
valid_features, valid_labels = pickle.load(open('preprocess_validation.p', mode='rb'))
Build the network¶
For the neural network, you'll build each layer into a function. Most of the code you've seen has been outside of functions. To test your code more thoroughly, we require that you put each layer in a function. This allows us to give you better feedback and test for simple mistakes using our unittests before you submit your project.
Note: If you're finding it hard to dedicate enough time for this course each week, we've provided a small shortcut to this part of the project. In the next couple of problems, you'll have the option to use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages to build each layer, except the layers you build in the "Convolutional and Max Pooling Layer" section. TF Layers is similar to Keras's and TFLearn's abstraction to layers, so it's easy to pickup.
However, if you would like to get the most out of this course, try to solve all the problems without using anything from the TF Layers packages. You can still use classes from other packages that happen to have the same name as ones you find in TF Layers! For example, instead of using the TF Layers version of the
conv2dclass, tf.layers.conv2d, you would want to use the TF Neural Network version ofconv2d, tf.nn.conv2d.
Let's begin!
Input¶
The neural network needs to read the image data, one-hot encoded labels, and dropout keep probability. Implement the following functions
- Implement
neural_net_image_input- Return a TF Placeholder
- Set the shape using
image_shapewith batch size set toNone. - Name the TensorFlow placeholder "x" using the TensorFlow
nameparameter in the TF Placeholder.
- Implement
neural_net_label_input- Return a TF Placeholder
- Set the shape using
n_classeswith batch size set toNone. - Name the TensorFlow placeholder "y" using the TensorFlow
nameparameter in the TF Placeholder.
- Implement
neural_net_keep_prob_input- Return a TF Placeholder for dropout keep probability.
- Name the TensorFlow placeholder "keep_prob" using the TensorFlow
nameparameter in the TF Placeholder.
These names will be used at the end of the project to load your saved model.
Note: None for shapes in TensorFlow allow for a dynamic size.
In [11]:
def neural_net_input(image_shape, n_classes):
# Grouping nodes into a single name scope in the computation graph.
with tf.name_scope('inputs'):
x = tf.placeholder(tf.float32, [None] + list(image_shape), name='x')
y = tf.placeholder(tf.float32, [None ,n_classes], name='y')
keep_prob_1 = tf.placeholder(tf.float32, None, name="keep_prob_1")
keep_prob_2 = tf.placeholder(tf.float32, None, name="keep_prob_2")
learning_rate = tf.placeholder(tf.float32, None, "lr")
is_training=tf.placeholder(tf.bool, None, name='is_training')
return x, y, keep_prob_1, keep_prob_2, learning_rate, is_training
'''
def neural_net_image_input(image_shape):
"""
Return a Tensor for a batch of image input
: image_shape: Shape of the images
: return: Tensor for image input.
"""
# TODO: Implement Function
# usage : tf.placeholder(dtype, shape=None, name=None)
return tf.placeholder(tf.float32, [None] + list(image_shape), name='x')
def neural_net_label_input(n_classes):
"""
Return a Tensor for a batch of label input
: n_classes: Number of classes
: return: Tensor for label input.
"""
# TODO: Implement Function
return tf.placeholder(tf.float32, [None ,n_classes], name='y')
def neural_net_keep_prob_input():
"""
Return a Tensor for keep probability
: return: Tensor for keep probability.
"""
# TODO: Implement Function
return tf.placeholder(tf.float32, None, name="keep_prob")
'''
Out[11]:
'\ndef neural_net_image_input(image_shape):\n """\n Return a Tensor for a batch of image input\n : image_shape: Shape of the images\n : return: Tensor for image input.\n """\n # TODO: Implement Function\n # usage : tf.placeholder(dtype, shape=None, name=None)\n return tf.placeholder(tf.float32, [None] + list(image_shape), name=\'x\')\n\n\ndef neural_net_label_input(n_classes):\n """\n Return a Tensor for a batch of label input\n : n_classes: Number of classes\n : return: Tensor for label input.\n """\n # TODO: Implement Function\n return tf.placeholder(tf.float32, [None ,n_classes], name=\'y\')\n\n\ndef neural_net_keep_prob_input():\n """\n Return a Tensor for keep probability\n : return: Tensor for keep probability.\n """\n # TODO: Implement Function\n return tf.placeholder(tf.float32, None, name="keep_prob")\n'
Convolution and Max Pooling Layer¶
Convolution layers have a lot of success with images. For this code cell, you should implement the function conv2d_maxpool to apply convolution then max pooling:
- Create the weight and bias using
conv_ksize,conv_num_outputsand the shape ofx_tensor. - Apply a convolution to
x_tensorusing weight andconv_strides.- We recommend you use same padding, but you're welcome to use any padding.
- Add bias
- Add a nonlinear activation to the convolution.
- Apply Max Pooling using
pool_ksizeandpool_strides.- We recommend you use same padding, but you're welcome to use any padding.
Note: You can't use TensorFlow Layers or TensorFlow Layers (contrib) for this layer, but you can still use TensorFlow's Neural Network package. You may still use the shortcut option for all the other layers.
In [12]:
def conv2d(x_tensor, conv_num_outputs, conv_ksize, conv_strides, is_training, kernel_regularizer=None):
"""
Apply convolution then max pooling to x_tensor
:param x_tensor: TensorFlow Tensor
:param conv_num_outputs: Number of outputs for the convolutional layer
:param conv_ksize: kernal size 2-D Tuple for the convolutional layer
:param conv_strides: Stride 2-D Tuple for convolution
: return: A tensor that represents convolution of x_tensor
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
C_kshape = list(conv_ksize + (X_shape[-1],) + (conv_num_outputs,))
# The shape of the filter weight is (height, width, input_depth, output_depth)
# The shape of the filter bias is (output_depth,)
F_W = tf.Variable(tf.truncated_normal(C_kshape, mean=0.0, stddev=np.sqrt(2.0/np.prod(C_kshape[:3]))),dtype=np.float32)
#F_W = tf.get_variable('W', shape=C_kshape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
#F_b = tf.Variable(tf.truncated_normal(conv_num_outputs, mean=0.0, stddev=0.15, dtype=np.float32))
if kernel_regularizer=='l2':
wd = 0.0001
weight_decay = tf.multiply(tf.nn.l2_loss(F_W), wd, name='weight_loss')
tf.add_to_collection('losses', weight_decay)
# The shape of the convolution stride is (batch_size, height, width, depth)
C_strides = list((1,)+conv_strides+(1,))
# The padding, either 'VALID' or 'SAME'.
padding = 'SAME'
#conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding) + F_b
conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding)
conv_output = tf.layers.batch_normalization(inputs=conv_output, training=is_training)
conv_output = tf.nn.relu(conv_output)
# Keeping track of weights and biases
tf.summary.histogram('weights', F_W)
#tf.summary.histogram('biases', F_b)
return conv_output
In [13]:
def pooling(x_tensor, pool_ksize, pool_strides, method='max'):
"""
Apply convolution then max pooling to x_tensor
:param x_tensor: TensorFlow Tensor
:param pool_ksize: kernal size 2-D Tuple for pool
:param pool_strides: Stride 2-D Tuple for pool
:param method: max/avg pooling, default is max
: return: A tensor that represents max pooling of x_tensor
"""
# TODO: Implement Function
# The padding, either 'VALID' or 'SAME'.
padding = 'SAME'
P_kshape = [1] + list(pool_ksize) + [1]
P_stride = [1] + list(pool_strides) + [1]
if(method=='max'):
conv_output = tf.nn.max_pool(x_tensor,P_kshape,P_stride,padding)
elif(method=='avg'):
conv_output = tf.nn.avg_pool(x_tensor,P_kshape,P_stride,padding)
return conv_output
Flatten Layer¶
Implement the flatten function to change the dimension of x_tensor from a 4-D tensor to a 2-D tensor. The output should be the shape (Batch Size, Flattened Image Size). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
In [14]:
def flatten(x_tensor):
"""
Flatten x_tensor to (Batch Size, Flattened Image Size)
: x_tensor: A tensor of size (Batch Size, ...), where ... are the image dimensions.
: return: A tensor of size (Batch Size, Flattened Image Size).
"""
# TODO: Implement Function
# reference : https://github.com/tensorflow/tensorflow/issues/7253
X_shape = x_tensor.get_shape().as_list()
return tf.reshape(x_tensor,[-1,np.prod(X_shape[1:])])
Fully-Connected Layer¶
Implement the fully_conn function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
In [15]:
def fully_conn(x_tensor, num_outputs, is_training, kernel_regularizer=None):
"""
Apply a fully connected layer to x_tensor using weight and bias
: x_tensor: A 2-D tensor where the first dimension is batch size.
: num_outputs: The number of output that the new tensor should be.
: return: A 2-D tensor where the second dimension is num_outputs.
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
shape = list((X_shape[-1],)+(num_outputs,))
W = tf.Variable(tf.truncated_normal(shape, mean=0.0, stddev=np.sqrt(2.0/np.prod(shape[0]))),dtype=np.float32)
#W = tf.get_variable('W', shape=shape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
#b = tf.Variable(tf.truncated_normal(num_outputs ,mean=0.0, stddev=0.15, dtype=np.float32))
if kernel_regularizer=='l2':
wd = 0.0001
weight_decay = tf.multiply(tf.nn.l2_loss(W), wd, name='weight_loss')
tf.add_to_collection('losses', weight_decay)
#fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))+b
fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))
fc_output = tf.layers.batch_normalization(inputs=fc_output, training=is_training)
fc_output = tf.nn.relu(fc_output)
# Keeping track of weights and biases
tf.summary.histogram('weights', W)
#tf.summary.histogram('biases', b)
return fc_output
Output Layer¶
Implement the output function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.
Note: Activation, softmax, or cross entropy should not be applied to this.
In [16]:
def output(x_tensor, num_outputs):
"""
Apply a output layer to x_tensor using weight and bias
: x_tensor: A 2-D tensor where the first dimension is batch size.
: num_outputs: The number of output that the new tensor should be.
: return: A 2-D tensor where the second dimension is num_outputs.
"""
# TODO: Implement Function
X_shape = x_tensor.get_shape().as_list()
shape = list((X_shape[-1],)+(num_outputs,))
W = tf.Variable(tf.truncated_normal(shape,0.0,0.01),dtype=np.float32)
b = tf.Variable(tf.zeros(num_outputs,dtype=np.float32))
return tf.tensordot(x_tensor,W,axes=([1], [0]))+b
In [17]:
def global_avg_pooling(x_tensor, stride=1):
X_shape = x_tensor.get_shape().as_list()
width = X_shape[1]
height = X_shape[2]
pool_size = [width, height]
output = tf.layers.average_pooling2d(inputs=x_tensor, pool_size=pool_size, strides=stride)
output_shape = output.get_shape().as_list()
return tf.reshape(output,[-1,np.prod(output_shape[1:])])
Create Convolutional Model¶
Implement the function conv_net to create a convolutional neural network model. The function takes in a batch of images, x, and outputs logits. Use the layers you created above to create this model:
- Apply 1, 2, or 3 Convolution and Max Pool layers
- Apply a Flatten Layer
- Apply 1, 2, or 3 Fully Connected Layers
- Apply an Output Layer
- Return the output
- Apply TensorFlow's Dropout to one or more layers in the model using
keep_prob.
In [18]:
def conv_net(x, keep_prob_1, keep_prob_2, is_training=False):
"""
Create a convolutional neural network model
: x: Placeholder tensor that holds image data.
: keep_prob: Placeholder tensor that hold dropout keep probability.
: is_training: Placeholder bool that hold the flag to determine training is True or False, default is False
: return: Tensor that represents logits
"""
with tf.name_scope("CNN"):
# TODO: Apply 1, 2, or 3 Convolution and Max Pool layers
# Play around with different number of outputs, kernel size and stride
# Function Definition from Above:
# conv2d_maxpool(x_tensor, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides)
conv_num_outputs = [96, 192, 192, 10]
conv_ksize, conv_strides, pool_ksize, pool_strides = (3, 3), (1, 1), (3, 3), (2, 2)
# 96 conv: 2 max_pool: 1
with tf.variable_scope("conv2d_1"):
conv = conv2d(x, conv_num_outputs[0], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
with tf.variable_scope("conv2d_2"):
conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
with tf.variable_scope("conv2d_3"):
conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
with tf.variable_scope("maxpool_1"):
pool = pooling(conv, pool_ksize, pool_strides, 'max')
with tf.variable_scope("dropout_1"):
result = tf.nn.dropout(pool, keep_prob_1)
# 192 conv: 3 max_pool: 1
with tf.variable_scope("conv2d_4"):
conv = conv2d(result, conv_num_outputs[1], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
with tf.variable_scope("conv2d_5"):
conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
with tf.variable_scope("conv2d_6"):
conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
with tf.variable_scope("maxpool_2"):
pool = pooling(conv, pool_ksize, pool_strides, 'max')
with tf.variable_scope("dropout_2"):
result = tf.nn.dropout(pool, keep_prob_1)
# 192 conv: 3 max_pool: 0
with tf.variable_scope("conv2d_7"):
conv = conv2d(result, conv_num_outputs[2], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
conv_ksize, conv_strides = (1, 1), (1, 1)
with tf.variable_scope("conv2d_8"):
conv = conv2d(conv, conv_num_outputs[2], conv_ksize, conv_strides, is_training)
with tf.variable_scope("conv2d_9"):
conv = conv2d(conv, conv_num_outputs[3], conv_ksize, conv_strides, is_training)
with tf.variable_scope("dropout_3"):
result = tf.nn.dropout(conv, keep_prob_1)
with tf.variable_scope("global_avgpool"):
o = global_avg_pooling(result)
# TODO: Apply a Flatten Layer
# Function Definition from Above:
# flatten(x_tensor)
#flattened = flatten(result)
# TODO: Apply 1, 2, or 3 Fully Connected Layers
# Play around with different number of outputs
# Function Definition from Above:
# fully_conn(x_tensor, num_outputs)
#num_outputs = [250, 150, 50]
#with tf.variable_scope("fc1"):
# fully = fully_conn(flattened, num_outputs[0], is_training, kernel_regularizer='l2')
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
#with tf.variable_scope("fc2"):
# fully = fully_conn(fc_layer, num_outputs[1], is_training)
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
#with tf.variable_scope("fc3"):
# fully = fully_conn(fc_layer, num_outputs[2], is_training)
# fc_layer = tf.nn.dropout(fully, keep_prob_2)
# TODO: Apply an Output Layer
# Set this to the number of classes
# Function Definition from Above:
# output(x_tensor, num_outputs)
#o = output(fc_layer, 10)
# TODO: return output
return o
Building a training op¶
In [19]:
##############################
## Build the Neural Network ##
##############################
def build_op():
# Remove previous weights, bias, inputs, etc..
tf.reset_default_graph()
# Inputs
x, y, keep_prob_1, keep_prob_2, lr, is_training = neural_net_input((32,32,3), 10)
# Model
logits = conv_net(x, keep_prob_1, keep_prob_2, is_training)
global_step = tf.Variable(0)
# Name logits Tensor, so that is can be loaded from disk after training
with tf.name_scope('logits'):
logits = tf.identity(logits, name='logits')
# Loss and Optimizer
with tf.name_scope('cost'):
cross_entropy_mean = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits_v2(logits=logits, labels=y), name='cross_entropy_mean')
tf.add_to_collection('losses', cross_entropy_mean)
cost = tf.add_n(tf.get_collection('losses'), name='cost')
loss_summ = tf.summary.scalar('loss', cost)
#with tf.name_scope('cost'):
# cost = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits(logits=logits, labels=y), name='cost')
#loss_summ = tf.summary.scalar('loss', cost)
with tf.name_scope('train'):
# batch normalization in tensorflow requires this update dependency
update_ops = tf.get_collection(tf.GraphKeys.UPDATE_OPS)
with tf.control_dependencies(update_ops):
optimizer = tf.train.AdamOptimizer(learning_rate=lr).minimize(cost, global_step=global_step)
#tf.add_to_collection('cost_op', cost)
#tf.add_to_collection('train_op', optimizer)
# Accuracy
with tf.name_scope('predictions'):
correct_pred = tf.equal(tf.argmax(logits, 1), tf.argmax(y, 1))
accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32), name='accuracy')
accuracy_summ = tf.summary.scalar('accuracy', accuracy)
#summary = tf.summary.merge([loss_summ, accuracy_summ], name='summary')
#Alternatively, you can use tf.summary.merge_all()
summary = tf.summary.merge_all()
return x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training
Train the Neural Network¶
Single Optimization¶
Implement the function train_neural_network to do a single optimization. The optimization should use optimizer to optimize in session with a feed_dict of the following:
xfor image inputyfor labelskeep_probfor keep probability for dropout
This function will be called for each batch, so tf.global_variables_initializer() has already been called.
Note: Nothing needs to be returned. This function is only optimizing the neural network.
In [20]:
def train_neural_network(session, optimizer, keep_probability, feature_batch, label_batch, learn_rate_value):
"""
Optimize the session on a batch of images and labels
: session: Current TensorFlow session
: optimizer: TensorFlow optimizer function
: keep_probability: keep probability
: feature_batch: Batch of Numpy image data
: label_batch: Batch of Numpy label data
"""
# TODO: Implement Function
session.run(optimizer, feed_dict={x:feature_batch, y:label_batch,
keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1],
lr:learn_rate_value, is_training:True})
Show Stats¶
Implement the function print_stats to print loss and validation accuracy. Use the global variables valid_features and valid_labels to calculate validation accuracy. Use a keep probability of 1.0 to calculate the loss and validation accuracy.
In [21]:
def print_stats(session, feature_batch, label_batch, cost, accuracy, learn_rate_value):
"""
Print information about loss and validation accuracy
: session: Current TensorFlow session
: feature_batch: Batch of Numpy image data
: label_batch: Batch of Numpy label data
: cost: TensorFlow cost function
: accuracy: TensorFlow accuracy function
"""
# TODO: Implement Function
loss = session.run(cost, feed_dict={x:feature_batch, y:label_batch, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learn_rate_value, is_training: True})
valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learn_rate_value, is_training: False})
print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
return loss, valid_acc
Hyperparameters¶
Tune the following parameters:
- Set
epochsto the number of iterations until the network stops learning or start overfitting - Set
batch_sizeto the highest number that your machine has memory for. Most people set them to common sizes of memory:- 64
- 128
- 256
- ...
- Set
keep_probabilityto the probability of keeping a node using dropout
In [22]:
# TODO: Tune Parameters
epochs = 164
batch_size = 128
keep_probability = [0.5, 0.75]
learning_rate_init = 0.001
Train on a Single CIFAR-10 Batch¶
Instead of training the neural network on all the CIFAR-10 batches of data, let's use a single batch. This should save time while you iterate on the model to get a better accuracy. Once the final validation accuracy is 50% or greater, run the model on all the data in the next section.
In [23]:
print('Checking the Training on a Single Batch...')
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
with tf.Session() as sess:
# Initializing the variables
sess.run(tf.global_variables_initializer())
# Training cycle
learning_rate = learning_rate_init
for epoch in range(epochs):
batch_i = 1
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
Checking the Training on a Single Batch... Epoch 1, CIFAR-10 Batch 1: Loss: 1.6151 Validation Accuracy: 0.216800 Epoch 2, CIFAR-10 Batch 1: Loss: 1.3846 Validation Accuracy: 0.177600 Epoch 3, CIFAR-10 Batch 1: Loss: 1.2186 Validation Accuracy: 0.289600 Epoch 4, CIFAR-10 Batch 1: Loss: 1.0574 Validation Accuracy: 0.341600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.9511 Validation Accuracy: 0.395600 Epoch 6, CIFAR-10 Batch 1: Loss: 0.8444 Validation Accuracy: 0.485000 Epoch 7, CIFAR-10 Batch 1: Loss: 0.7607 Validation Accuracy: 0.576200 Epoch 8, CIFAR-10 Batch 1: Loss: 0.6634 Validation Accuracy: 0.464800 Epoch 9, CIFAR-10 Batch 1: Loss: 0.6231 Validation Accuracy: 0.493000 Epoch 10, CIFAR-10 Batch 1: Loss: 0.5038 Validation Accuracy: 0.625200 Epoch 11, CIFAR-10 Batch 1: Loss: 0.4343 Validation Accuracy: 0.562400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.4356 Validation Accuracy: 0.635600 Epoch 13, CIFAR-10 Batch 1: Loss: 0.3650 Validation Accuracy: 0.600800 Epoch 14, CIFAR-10 Batch 1: Loss: 0.3214 Validation Accuracy: 0.603600 Epoch 15, CIFAR-10 Batch 1: Loss: 0.3309 Validation Accuracy: 0.610800 Epoch 16, CIFAR-10 Batch 1: Loss: 0.2604 Validation Accuracy: 0.580000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.2227 Validation Accuracy: 0.641000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.2102 Validation Accuracy: 0.617400 Epoch 19, CIFAR-10 Batch 1: Loss: 0.1904 Validation Accuracy: 0.630800 Epoch 20, CIFAR-10 Batch 1: Loss: 0.1612 Validation Accuracy: 0.600200 Epoch 21, CIFAR-10 Batch 1: Loss: 0.1596 Validation Accuracy: 0.526000 Epoch 22, CIFAR-10 Batch 1: Loss: 0.1324 Validation Accuracy: 0.632400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.1235 Validation Accuracy: 0.634000 Epoch 24, CIFAR-10 Batch 1: Loss: 0.1264 Validation Accuracy: 0.608400 Epoch 25, CIFAR-10 Batch 1: Loss: 0.1151 Validation Accuracy: 0.613600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.1119 Validation Accuracy: 0.698200 Epoch 27, CIFAR-10 Batch 1: Loss: 0.1017 Validation Accuracy: 0.648200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.0973 Validation Accuracy: 0.658600 Epoch 29, CIFAR-10 Batch 1: Loss: 0.0930 Validation Accuracy: 0.668600 Epoch 30, CIFAR-10 Batch 1: Loss: 0.0946 Validation Accuracy: 0.690800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.0836 Validation Accuracy: 0.686400 Epoch 32, CIFAR-10 Batch 1: Loss: 0.0818 Validation Accuracy: 0.646400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.0757 Validation Accuracy: 0.662400 Epoch 34, CIFAR-10 Batch 1: Loss: 0.0737 Validation Accuracy: 0.652600 Epoch 35, CIFAR-10 Batch 1: Loss: 0.0768 Validation Accuracy: 0.702400 Epoch 36, CIFAR-10 Batch 1: Loss: 0.0723 Validation Accuracy: 0.682000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.0674 Validation Accuracy: 0.699400 Epoch 38, CIFAR-10 Batch 1: Loss: 0.0663 Validation Accuracy: 0.694800 Epoch 39, CIFAR-10 Batch 1: Loss: 0.0648 Validation Accuracy: 0.764200 Epoch 40, CIFAR-10 Batch 1: Loss: 0.0658 Validation Accuracy: 0.733400 Epoch 41, CIFAR-10 Batch 1: Loss: 0.0633 Validation Accuracy: 0.690000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.0623 Validation Accuracy: 0.751800 Epoch 43, CIFAR-10 Batch 1: Loss: 0.0613 Validation Accuracy: 0.695200 Epoch 44, CIFAR-10 Batch 1: Loss: 0.0595 Validation Accuracy: 0.717200 Epoch 45, CIFAR-10 Batch 1: Loss: 0.0596 Validation Accuracy: 0.750400 Epoch 46, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.753400 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0574 Validation Accuracy: 0.762200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.0551 Validation Accuracy: 0.706800 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0544 Validation Accuracy: 0.742200 Epoch 50, CIFAR-10 Batch 1: Loss: 0.0538 Validation Accuracy: 0.736200 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0527 Validation Accuracy: 0.758800 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0513 Validation Accuracy: 0.758600 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0533 Validation Accuracy: 0.717200 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0542 Validation Accuracy: 0.760000 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0510 Validation Accuracy: 0.763200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0497 Validation Accuracy: 0.771200 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0518 Validation Accuracy: 0.737600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0490 Validation Accuracy: 0.687200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0496 Validation Accuracy: 0.726000 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0496 Validation Accuracy: 0.739400 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0489 Validation Accuracy: 0.746800 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0487 Validation Accuracy: 0.711800 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0476 Validation Accuracy: 0.728600 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0477 Validation Accuracy: 0.666200 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0485 Validation Accuracy: 0.697600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0493 Validation Accuracy: 0.748200 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0484 Validation Accuracy: 0.743000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0482 Validation Accuracy: 0.718400 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0481 Validation Accuracy: 0.707200 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0472 Validation Accuracy: 0.668800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0490 Validation Accuracy: 0.771400 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0477 Validation Accuracy: 0.745000 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0487 Validation Accuracy: 0.686000 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0486 Validation Accuracy: 0.719400 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0483 Validation Accuracy: 0.759600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0473 Validation Accuracy: 0.704600 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0479 Validation Accuracy: 0.734800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0466 Validation Accuracy: 0.733400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0462 Validation Accuracy: 0.756600 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0488 Validation Accuracy: 0.771200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0462 Validation Accuracy: 0.747400 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0455 Validation Accuracy: 0.796000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.802400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.801600 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.801200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800600 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800600 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800400 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800200 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800600 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799000 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800200 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.800200 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799000 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799800 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.799400
Fully Train the Model¶
Now that you got a good accuracy with a single CIFAR-10 batch, try it with all five batches.
In [23]:
loss = []
acc = []
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
print('Training...')
with tf.Session() as sess:
# Initializing the variables
sess.run(tf.global_variables_initializer())
learning_rate = learning_rate_init
# Training cycle
for epoch in range(epochs):
# Loop over all batches
n_batches = 5
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_i in range(1, n_batches + 1):
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
train_loss,val_acc=print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
loss.append(train_loss)
acc.append(val_acc)
# Save Model
save_model_path = './image_classification(learning_rate={:.5f},batch_size={})'.format(learning_rate_init, batch_size)
saver = tf.train.Saver()
save_path = saver.save(sess, save_model_path)
Training... Epoch 1, CIFAR-10 Batch 1: Loss: 1.5681 Validation Accuracy: 0.211800 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6051 Validation Accuracy: 0.162200 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3923 Validation Accuracy: 0.427000 Epoch 1, CIFAR-10 Batch 4: Loss: 1.2221 Validation Accuracy: 0.478600 Epoch 1, CIFAR-10 Batch 5: Loss: 1.2599 Validation Accuracy: 0.517600 Epoch 2, CIFAR-10 Batch 1: Loss: 1.0210 Validation Accuracy: 0.505800 Epoch 2, CIFAR-10 Batch 2: Loss: 1.2014 Validation Accuracy: 0.631000 Epoch 2, CIFAR-10 Batch 3: Loss: 0.9138 Validation Accuracy: 0.561200 Epoch 2, CIFAR-10 Batch 4: Loss: 0.9176 Validation Accuracy: 0.568000 Epoch 2, CIFAR-10 Batch 5: Loss: 0.8570 Validation Accuracy: 0.604800 Epoch 3, CIFAR-10 Batch 1: Loss: 0.8484 Validation Accuracy: 0.520000 Epoch 3, CIFAR-10 Batch 2: Loss: 0.9036 Validation Accuracy: 0.668600 Epoch 3, CIFAR-10 Batch 3: Loss: 0.6119 Validation Accuracy: 0.685400 Epoch 3, CIFAR-10 Batch 4: Loss: 0.6788 Validation Accuracy: 0.691200 Epoch 3, CIFAR-10 Batch 5: Loss: 0.6208 Validation Accuracy: 0.676000 Epoch 4, CIFAR-10 Batch 1: Loss: 0.6124 Validation Accuracy: 0.667000 Epoch 4, CIFAR-10 Batch 2: Loss: 0.6847 Validation Accuracy: 0.703000 Epoch 4, CIFAR-10 Batch 3: Loss: 0.4971 Validation Accuracy: 0.731600 Epoch 4, CIFAR-10 Batch 4: Loss: 0.5434 Validation Accuracy: 0.719000 Epoch 4, CIFAR-10 Batch 5: Loss: 0.4977 Validation Accuracy: 0.688800 Epoch 5, CIFAR-10 Batch 1: Loss: 0.4410 Validation Accuracy: 0.682400 Epoch 5, CIFAR-10 Batch 2: Loss: 0.5712 Validation Accuracy: 0.683200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.4206 Validation Accuracy: 0.768400 Epoch 5, CIFAR-10 Batch 4: Loss: 0.4390 Validation Accuracy: 0.709000 Epoch 5, CIFAR-10 Batch 5: Loss: 0.3951 Validation Accuracy: 0.772000 Epoch 6, CIFAR-10 Batch 1: Loss: 0.3965 Validation Accuracy: 0.685000 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4868 Validation Accuracy: 0.750000 Epoch 6, CIFAR-10 Batch 3: Loss: 0.3495 Validation Accuracy: 0.756800 Epoch 6, CIFAR-10 Batch 4: Loss: 0.3835 Validation Accuracy: 0.770600 Epoch 6, CIFAR-10 Batch 5: Loss: 0.2995 Validation Accuracy: 0.725600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.3275 Validation Accuracy: 0.765800 Epoch 7, CIFAR-10 Batch 2: Loss: 0.3591 Validation Accuracy: 0.744600 Epoch 7, CIFAR-10 Batch 3: Loss: 0.2969 Validation Accuracy: 0.716200 Epoch 7, CIFAR-10 Batch 4: Loss: 0.3501 Validation Accuracy: 0.765600 Epoch 7, CIFAR-10 Batch 5: Loss: 0.2512 Validation Accuracy: 0.792400 Epoch 8, CIFAR-10 Batch 1: Loss: 0.2681 Validation Accuracy: 0.709000 Epoch 8, CIFAR-10 Batch 2: Loss: 0.3480 Validation Accuracy: 0.762000 Epoch 8, CIFAR-10 Batch 3: Loss: 0.2658 Validation Accuracy: 0.751200 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3043 Validation Accuracy: 0.787400 Epoch 8, CIFAR-10 Batch 5: Loss: 0.1895 Validation Accuracy: 0.799200 Epoch 9, CIFAR-10 Batch 1: Loss: 0.2084 Validation Accuracy: 0.736800 Epoch 9, CIFAR-10 Batch 2: Loss: 0.2724 Validation Accuracy: 0.777000 Epoch 9, CIFAR-10 Batch 3: Loss: 0.2143 Validation Accuracy: 0.777000 Epoch 9, CIFAR-10 Batch 4: Loss: 0.2793 Validation Accuracy: 0.819200 Epoch 9, CIFAR-10 Batch 5: Loss: 0.1706 Validation Accuracy: 0.774600 Epoch 10, CIFAR-10 Batch 1: Loss: 0.1903 Validation Accuracy: 0.795000 Epoch 10, CIFAR-10 Batch 2: Loss: 0.2464 Validation Accuracy: 0.750800 Epoch 10, CIFAR-10 Batch 3: Loss: 0.2112 Validation Accuracy: 0.811400 Epoch 10, CIFAR-10 Batch 4: Loss: 0.2369 Validation Accuracy: 0.751000 Epoch 10, CIFAR-10 Batch 5: Loss: 0.1442 Validation Accuracy: 0.776200 Epoch 11, CIFAR-10 Batch 1: Loss: 0.1622 Validation Accuracy: 0.797200 Epoch 11, CIFAR-10 Batch 2: Loss: 0.2170 Validation Accuracy: 0.765200 Epoch 11, CIFAR-10 Batch 3: Loss: 0.1758 Validation Accuracy: 0.755200 Epoch 11, CIFAR-10 Batch 4: Loss: 0.2244 Validation Accuracy: 0.743200 Epoch 11, CIFAR-10 Batch 5: Loss: 0.1056 Validation Accuracy: 0.820400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.1245 Validation Accuracy: 0.787600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.1890 Validation Accuracy: 0.782200 Epoch 12, CIFAR-10 Batch 3: Loss: 0.1469 Validation Accuracy: 0.679000 Epoch 12, CIFAR-10 Batch 4: Loss: 0.1894 Validation Accuracy: 0.762800 Epoch 12, CIFAR-10 Batch 5: Loss: 0.1062 Validation Accuracy: 0.831400 Epoch 13, CIFAR-10 Batch 1: Loss: 0.1302 Validation Accuracy: 0.815600 Epoch 13, CIFAR-10 Batch 2: Loss: 0.1588 Validation Accuracy: 0.720800 Epoch 13, CIFAR-10 Batch 3: Loss: 0.1439 Validation Accuracy: 0.810600 Epoch 13, CIFAR-10 Batch 4: Loss: 0.1466 Validation Accuracy: 0.782000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.1000 Validation Accuracy: 0.803600 Epoch 14, CIFAR-10 Batch 1: Loss: 0.1178 Validation Accuracy: 0.801800 Epoch 14, CIFAR-10 Batch 2: Loss: 0.1367 Validation Accuracy: 0.778400 Epoch 14, CIFAR-10 Batch 3: Loss: 0.1236 Validation Accuracy: 0.792200 Epoch 14, CIFAR-10 Batch 4: Loss: 0.1597 Validation Accuracy: 0.825800 Epoch 14, CIFAR-10 Batch 5: Loss: 0.0918 Validation Accuracy: 0.796200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.1028 Validation Accuracy: 0.732800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.1418 Validation Accuracy: 0.815800 Epoch 15, CIFAR-10 Batch 3: Loss: 0.1111 Validation Accuracy: 0.823600 Epoch 15, CIFAR-10 Batch 4: Loss: 0.1379 Validation Accuracy: 0.814200 Epoch 15, CIFAR-10 Batch 5: Loss: 0.0804 Validation Accuracy: 0.829200 Epoch 16, CIFAR-10 Batch 1: Loss: 0.0858 Validation Accuracy: 0.761200 Epoch 16, CIFAR-10 Batch 2: Loss: 0.1272 Validation Accuracy: 0.736800 Epoch 16, CIFAR-10 Batch 3: Loss: 0.1139 Validation Accuracy: 0.781200 Epoch 16, CIFAR-10 Batch 4: Loss: 0.1133 Validation Accuracy: 0.845000 Epoch 16, CIFAR-10 Batch 5: Loss: 0.0784 Validation Accuracy: 0.841200 Epoch 17, CIFAR-10 Batch 1: Loss: 0.0909 Validation Accuracy: 0.810200 Epoch 17, CIFAR-10 Batch 2: Loss: 0.1121 Validation Accuracy: 0.745000 Epoch 17, CIFAR-10 Batch 3: Loss: 0.1021 Validation Accuracy: 0.781600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.1143 Validation Accuracy: 0.837600 Epoch 17, CIFAR-10 Batch 5: Loss: 0.0789 Validation Accuracy: 0.830600 Epoch 18, CIFAR-10 Batch 1: Loss: 0.0817 Validation Accuracy: 0.802400 Epoch 18, CIFAR-10 Batch 2: Loss: 0.1072 Validation Accuracy: 0.819400 Epoch 18, CIFAR-10 Batch 3: Loss: 0.0986 Validation Accuracy: 0.827000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.1198 Validation Accuracy: 0.853400 Epoch 18, CIFAR-10 Batch 5: Loss: 0.0764 Validation Accuracy: 0.844200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.0798 Validation Accuracy: 0.791400 Epoch 19, CIFAR-10 Batch 2: Loss: 0.1016 Validation Accuracy: 0.843600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.1028 Validation Accuracy: 0.856200 Epoch 19, CIFAR-10 Batch 4: Loss: 0.1029 Validation Accuracy: 0.829600 Epoch 19, CIFAR-10 Batch 5: Loss: 0.0735 Validation Accuracy: 0.848000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.0792 Validation Accuracy: 0.759600 Epoch 20, CIFAR-10 Batch 2: Loss: 0.1023 Validation Accuracy: 0.815800 Epoch 20, CIFAR-10 Batch 3: Loss: 0.0924 Validation Accuracy: 0.829800 Epoch 20, CIFAR-10 Batch 4: Loss: 0.0917 Validation Accuracy: 0.860800 Epoch 20, CIFAR-10 Batch 5: Loss: 0.0730 Validation Accuracy: 0.845000 Epoch 21, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.807200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.0932 Validation Accuracy: 0.834400 Epoch 21, CIFAR-10 Batch 3: Loss: 0.0832 Validation Accuracy: 0.831400 Epoch 21, CIFAR-10 Batch 4: Loss: 0.1005 Validation Accuracy: 0.831000 Epoch 21, CIFAR-10 Batch 5: Loss: 0.0758 Validation Accuracy: 0.846200 Epoch 22, CIFAR-10 Batch 1: Loss: 0.0829 Validation Accuracy: 0.806400 Epoch 22, CIFAR-10 Batch 2: Loss: 0.0922 Validation Accuracy: 0.814400 Epoch 22, CIFAR-10 Batch 3: Loss: 0.0842 Validation Accuracy: 0.845200 Epoch 22, CIFAR-10 Batch 4: Loss: 0.0895 Validation Accuracy: 0.810800 Epoch 22, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.846000 Epoch 23, CIFAR-10 Batch 1: Loss: 0.0781 Validation Accuracy: 0.810200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.0887 Validation Accuracy: 0.853200 Epoch 23, CIFAR-10 Batch 3: Loss: 0.0891 Validation Accuracy: 0.839600 Epoch 23, CIFAR-10 Batch 4: Loss: 0.0869 Validation Accuracy: 0.850200 Epoch 23, CIFAR-10 Batch 5: Loss: 0.0736 Validation Accuracy: 0.870000 Epoch 24, CIFAR-10 Batch 1: Loss: 0.0773 Validation Accuracy: 0.773000 Epoch 24, CIFAR-10 Batch 2: Loss: 0.0863 Validation Accuracy: 0.767600 Epoch 24, CIFAR-10 Batch 3: Loss: 0.0840 Validation Accuracy: 0.843000 Epoch 24, CIFAR-10 Batch 4: Loss: 0.0969 Validation Accuracy: 0.837600 Epoch 24, CIFAR-10 Batch 5: Loss: 0.0744 Validation Accuracy: 0.853200 Epoch 25, CIFAR-10 Batch 1: Loss: 0.0741 Validation Accuracy: 0.847200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.0884 Validation Accuracy: 0.808400 Epoch 25, CIFAR-10 Batch 3: Loss: 0.0816 Validation Accuracy: 0.854600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.0873 Validation Accuracy: 0.839200 Epoch 25, CIFAR-10 Batch 5: Loss: 0.0773 Validation Accuracy: 0.851400 Epoch 26, CIFAR-10 Batch 1: Loss: 0.0747 Validation Accuracy: 0.813200 Epoch 26, CIFAR-10 Batch 2: Loss: 0.0892 Validation Accuracy: 0.791600 Epoch 26, CIFAR-10 Batch 3: Loss: 0.0795 Validation Accuracy: 0.832200 Epoch 26, CIFAR-10 Batch 4: Loss: 0.0810 Validation Accuracy: 0.820000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.0742 Validation Accuracy: 0.823400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.0774 Validation Accuracy: 0.811400 Epoch 27, CIFAR-10 Batch 2: Loss: 0.0859 Validation Accuracy: 0.843200 Epoch 27, CIFAR-10 Batch 3: Loss: 0.0782 Validation Accuracy: 0.865600 Epoch 27, CIFAR-10 Batch 4: Loss: 0.0815 Validation Accuracy: 0.857800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.842800 Epoch 28, CIFAR-10 Batch 1: Loss: 0.0770 Validation Accuracy: 0.844800 Epoch 28, CIFAR-10 Batch 2: Loss: 0.0806 Validation Accuracy: 0.831200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.0819 Validation Accuracy: 0.834000 Epoch 28, CIFAR-10 Batch 4: Loss: 0.0815 Validation Accuracy: 0.846800 Epoch 28, CIFAR-10 Batch 5: Loss: 0.0737 Validation Accuracy: 0.840600 Epoch 29, CIFAR-10 Batch 1: Loss: 0.0738 Validation Accuracy: 0.858600 Epoch 29, CIFAR-10 Batch 2: Loss: 0.0837 Validation Accuracy: 0.763600 Epoch 29, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.839800 Epoch 29, CIFAR-10 Batch 4: Loss: 0.0790 Validation Accuracy: 0.848600 Epoch 29, CIFAR-10 Batch 5: Loss: 0.0740 Validation Accuracy: 0.843000 Epoch 30, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.758400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.0807 Validation Accuracy: 0.765200 Epoch 30, CIFAR-10 Batch 3: Loss: 0.0786 Validation Accuracy: 0.856600 Epoch 30, CIFAR-10 Batch 4: Loss: 0.0796 Validation Accuracy: 0.846400 Epoch 30, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.833600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.810400 Epoch 31, CIFAR-10 Batch 2: Loss: 0.0878 Validation Accuracy: 0.825400 Epoch 31, CIFAR-10 Batch 3: Loss: 0.0804 Validation Accuracy: 0.828600 Epoch 31, CIFAR-10 Batch 4: Loss: 0.0788 Validation Accuracy: 0.827600 Epoch 31, CIFAR-10 Batch 5: Loss: 0.0746 Validation Accuracy: 0.841800 Epoch 32, CIFAR-10 Batch 1: Loss: 0.0753 Validation Accuracy: 0.847400 Epoch 32, CIFAR-10 Batch 2: Loss: 0.0835 Validation Accuracy: 0.845800 Epoch 32, CIFAR-10 Batch 3: Loss: 0.0807 Validation Accuracy: 0.829000 Epoch 32, CIFAR-10 Batch 4: Loss: 0.0783 Validation Accuracy: 0.861000 Epoch 32, CIFAR-10 Batch 5: Loss: 0.0759 Validation Accuracy: 0.848600 Epoch 33, CIFAR-10 Batch 1: Loss: 0.0766 Validation Accuracy: 0.813000 Epoch 33, CIFAR-10 Batch 2: Loss: 0.0823 Validation Accuracy: 0.793200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.0825 Validation Accuracy: 0.823600 Epoch 33, CIFAR-10 Batch 4: Loss: 0.0801 Validation Accuracy: 0.843400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.0741 Validation Accuracy: 0.873200 Epoch 34, CIFAR-10 Batch 1: Loss: 0.0768 Validation Accuracy: 0.830000 Epoch 34, CIFAR-10 Batch 2: Loss: 0.0785 Validation Accuracy: 0.774000 Epoch 34, CIFAR-10 Batch 3: Loss: 0.0792 Validation Accuracy: 0.849200 Epoch 34, CIFAR-10 Batch 4: Loss: 0.0855 Validation Accuracy: 0.816000 Epoch 34, CIFAR-10 Batch 5: Loss: 0.0763 Validation Accuracy: 0.852200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.832600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.0829 Validation Accuracy: 0.856000 Epoch 35, CIFAR-10 Batch 3: Loss: 0.0769 Validation Accuracy: 0.835600 Epoch 35, CIFAR-10 Batch 4: Loss: 0.0787 Validation Accuracy: 0.864400 Epoch 35, CIFAR-10 Batch 5: Loss: 0.0781 Validation Accuracy: 0.865800 Epoch 36, CIFAR-10 Batch 1: Loss: 0.0753 Validation Accuracy: 0.859000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.0849 Validation Accuracy: 0.816600 Epoch 36, CIFAR-10 Batch 3: Loss: 0.0762 Validation Accuracy: 0.874800 Epoch 36, CIFAR-10 Batch 4: Loss: 0.0817 Validation Accuracy: 0.842000 Epoch 36, CIFAR-10 Batch 5: Loss: 0.0752 Validation Accuracy: 0.857000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.0769 Validation Accuracy: 0.875200 Epoch 37, CIFAR-10 Batch 2: Loss: 0.0839 Validation Accuracy: 0.829600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.0797 Validation Accuracy: 0.847800 Epoch 37, CIFAR-10 Batch 4: Loss: 0.0853 Validation Accuracy: 0.830800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.0763 Validation Accuracy: 0.867800 Epoch 38, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.840000 Epoch 38, CIFAR-10 Batch 2: Loss: 0.0812 Validation Accuracy: 0.861200 Epoch 38, CIFAR-10 Batch 3: Loss: 0.0802 Validation Accuracy: 0.821800 Epoch 38, CIFAR-10 Batch 4: Loss: 0.0827 Validation Accuracy: 0.861800 Epoch 38, CIFAR-10 Batch 5: Loss: 0.0763 Validation Accuracy: 0.865000 Epoch 39, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.857200 Epoch 39, CIFAR-10 Batch 2: Loss: 0.0805 Validation Accuracy: 0.828200 Epoch 39, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.840600 Epoch 39, CIFAR-10 Batch 4: Loss: 0.0800 Validation Accuracy: 0.864400 Epoch 39, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.826600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.0756 Validation Accuracy: 0.855000 Epoch 40, CIFAR-10 Batch 2: Loss: 0.0818 Validation Accuracy: 0.861000 Epoch 40, CIFAR-10 Batch 3: Loss: 0.0797 Validation Accuracy: 0.832600 Epoch 40, CIFAR-10 Batch 4: Loss: 0.0781 Validation Accuracy: 0.836000 Epoch 40, CIFAR-10 Batch 5: Loss: 0.0767 Validation Accuracy: 0.880200 Epoch 41, CIFAR-10 Batch 1: Loss: 0.0765 Validation Accuracy: 0.829200 Epoch 41, CIFAR-10 Batch 2: Loss: 0.0793 Validation Accuracy: 0.846600 Epoch 41, CIFAR-10 Batch 3: Loss: 0.0779 Validation Accuracy: 0.799400 Epoch 41, CIFAR-10 Batch 4: Loss: 0.0789 Validation Accuracy: 0.873800 Epoch 41, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.867600 Epoch 42, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.844400 Epoch 42, CIFAR-10 Batch 2: Loss: 0.0825 Validation Accuracy: 0.861400 Epoch 42, CIFAR-10 Batch 3: Loss: 0.0789 Validation Accuracy: 0.848600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.0765 Validation Accuracy: 0.846800 Epoch 42, CIFAR-10 Batch 5: Loss: 0.0764 Validation Accuracy: 0.827600 Epoch 43, CIFAR-10 Batch 1: Loss: 0.0756 Validation Accuracy: 0.860800 Epoch 43, CIFAR-10 Batch 2: Loss: 0.0788 Validation Accuracy: 0.869800 Epoch 43, CIFAR-10 Batch 3: Loss: 0.0774 Validation Accuracy: 0.853800 Epoch 43, CIFAR-10 Batch 4: Loss: 0.0774 Validation Accuracy: 0.861400 Epoch 43, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.851200 Epoch 44, CIFAR-10 Batch 1: Loss: 0.0772 Validation Accuracy: 0.793800 Epoch 44, CIFAR-10 Batch 2: Loss: 0.0810 Validation Accuracy: 0.858000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.0779 Validation Accuracy: 0.849800 Epoch 44, CIFAR-10 Batch 4: Loss: 0.0781 Validation Accuracy: 0.856400 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0768 Validation Accuracy: 0.859400 Epoch 45, CIFAR-10 Batch 1: Loss: 0.0779 Validation Accuracy: 0.867200 Epoch 45, CIFAR-10 Batch 2: Loss: 0.0818 Validation Accuracy: 0.865000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.0797 Validation Accuracy: 0.869600 Epoch 45, CIFAR-10 Batch 4: Loss: 0.0811 Validation Accuracy: 0.863000 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.846800 Epoch 46, CIFAR-10 Batch 1: Loss: 0.0782 Validation Accuracy: 0.864800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.0802 Validation Accuracy: 0.810400 Epoch 46, CIFAR-10 Batch 3: Loss: 0.0776 Validation Accuracy: 0.801200 Epoch 46, CIFAR-10 Batch 4: Loss: 0.0846 Validation Accuracy: 0.850400 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0761 Validation Accuracy: 0.858000 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0758 Validation Accuracy: 0.868800 Epoch 47, CIFAR-10 Batch 2: Loss: 0.0812 Validation Accuracy: 0.854400 Epoch 47, CIFAR-10 Batch 3: Loss: 0.0773 Validation Accuracy: 0.851600 Epoch 47, CIFAR-10 Batch 4: Loss: 0.0772 Validation Accuracy: 0.840600 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0774 Validation Accuracy: 0.871200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.857800 Epoch 48, CIFAR-10 Batch 2: Loss: 0.0796 Validation Accuracy: 0.849400 Epoch 48, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.864000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.0763 Validation Accuracy: 0.861400 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0765 Validation Accuracy: 0.864600 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0764 Validation Accuracy: 0.861200 Epoch 49, CIFAR-10 Batch 2: Loss: 0.0784 Validation Accuracy: 0.877000 Epoch 49, CIFAR-10 Batch 3: Loss: 0.0769 Validation Accuracy: 0.837800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.0776 Validation Accuracy: 0.834000 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0770 Validation Accuracy: 0.842400 Epoch 50, CIFAR-10 Batch 1: Loss: 0.0771 Validation Accuracy: 0.866800 Epoch 50, CIFAR-10 Batch 2: Loss: 0.0804 Validation Accuracy: 0.875000 Epoch 50, CIFAR-10 Batch 3: Loss: 0.0770 Validation Accuracy: 0.855400 Epoch 50, CIFAR-10 Batch 4: Loss: 0.0760 Validation Accuracy: 0.871600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0756 Validation Accuracy: 0.859800 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.873000 Epoch 51, CIFAR-10 Batch 2: Loss: 0.0771 Validation Accuracy: 0.860400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.0765 Validation Accuracy: 0.814400 Epoch 51, CIFAR-10 Batch 4: Loss: 0.0770 Validation Accuracy: 0.858000 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.844000 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0752 Validation Accuracy: 0.848800 Epoch 52, CIFAR-10 Batch 2: Loss: 0.0781 Validation Accuracy: 0.846600 Epoch 52, CIFAR-10 Batch 3: Loss: 0.0782 Validation Accuracy: 0.868000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.0758 Validation Accuracy: 0.865600 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0760 Validation Accuracy: 0.861000 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0748 Validation Accuracy: 0.851200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.0786 Validation Accuracy: 0.845800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.0766 Validation Accuracy: 0.858800 Epoch 53, CIFAR-10 Batch 4: Loss: 0.0773 Validation Accuracy: 0.876600 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0752 Validation Accuracy: 0.851000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.853200 Epoch 54, CIFAR-10 Batch 2: Loss: 0.0784 Validation Accuracy: 0.854800 Epoch 54, CIFAR-10 Batch 3: Loss: 0.0775 Validation Accuracy: 0.847000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.0811 Validation Accuracy: 0.841200 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0759 Validation Accuracy: 0.843600 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0764 Validation Accuracy: 0.836400 Epoch 55, CIFAR-10 Batch 2: Loss: 0.0807 Validation Accuracy: 0.852000 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0777 Validation Accuracy: 0.865800 Epoch 55, CIFAR-10 Batch 4: Loss: 0.0815 Validation Accuracy: 0.861000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0759 Validation Accuracy: 0.877000 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0766 Validation Accuracy: 0.868800 Epoch 56, CIFAR-10 Batch 2: Loss: 0.0798 Validation Accuracy: 0.852600 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0761 Validation Accuracy: 0.877200 Epoch 56, CIFAR-10 Batch 4: Loss: 0.0772 Validation Accuracy: 0.872000 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0765 Validation Accuracy: 0.860400 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.873400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.0771 Validation Accuracy: 0.861000 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0796 Validation Accuracy: 0.874800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.858800 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.871000 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0762 Validation Accuracy: 0.880000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0826 Validation Accuracy: 0.859600 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0765 Validation Accuracy: 0.854600 Epoch 58, CIFAR-10 Batch 4: Loss: 0.0772 Validation Accuracy: 0.866200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.868200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0755 Validation Accuracy: 0.870000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.0854 Validation Accuracy: 0.848800 Epoch 59, CIFAR-10 Batch 3: Loss: 0.0761 Validation Accuracy: 0.803200 Epoch 59, CIFAR-10 Batch 4: Loss: 0.0780 Validation Accuracy: 0.869800 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0777 Validation Accuracy: 0.864800 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.857600 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0768 Validation Accuracy: 0.852000 Epoch 60, CIFAR-10 Batch 3: Loss: 0.0767 Validation Accuracy: 0.862800 Epoch 60, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.849200 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.861400 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.846400 Epoch 61, CIFAR-10 Batch 2: Loss: 0.0776 Validation Accuracy: 0.832000 Epoch 61, CIFAR-10 Batch 3: Loss: 0.0755 Validation Accuracy: 0.883400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0797 Validation Accuracy: 0.866800 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0749 Validation Accuracy: 0.870000 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0753 Validation Accuracy: 0.854400 Epoch 62, CIFAR-10 Batch 2: Loss: 0.0762 Validation Accuracy: 0.847200 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0760 Validation Accuracy: 0.835200 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0780 Validation Accuracy: 0.880200 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0765 Validation Accuracy: 0.871400 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.855000 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0775 Validation Accuracy: 0.862400 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0752 Validation Accuracy: 0.872000 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0760 Validation Accuracy: 0.878200 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0748 Validation Accuracy: 0.865800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0755 Validation Accuracy: 0.859600 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0777 Validation Accuracy: 0.857000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0757 Validation Accuracy: 0.855800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0766 Validation Accuracy: 0.875000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0749 Validation Accuracy: 0.853800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0749 Validation Accuracy: 0.861800 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0797 Validation Accuracy: 0.837800 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0750 Validation Accuracy: 0.874600 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.855000 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0751 Validation Accuracy: 0.868600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0755 Validation Accuracy: 0.845800 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0791 Validation Accuracy: 0.841000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0750 Validation Accuracy: 0.836600 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0781 Validation Accuracy: 0.863200 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.862600 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0749 Validation Accuracy: 0.872200 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0766 Validation Accuracy: 0.846200 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0750 Validation Accuracy: 0.849200 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0774 Validation Accuracy: 0.871200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.874400 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0748 Validation Accuracy: 0.867800 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0767 Validation Accuracy: 0.839800 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0758 Validation Accuracy: 0.853600 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0757 Validation Accuracy: 0.864000 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0750 Validation Accuracy: 0.885600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0751 Validation Accuracy: 0.873200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0791 Validation Accuracy: 0.868600 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0759 Validation Accuracy: 0.846400 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0818 Validation Accuracy: 0.855800 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.871600 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.863200 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0772 Validation Accuracy: 0.863800 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0758 Validation Accuracy: 0.845600 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0763 Validation Accuracy: 0.858600 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.856800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0752 Validation Accuracy: 0.861400 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0761 Validation Accuracy: 0.871000 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0746 Validation Accuracy: 0.866000 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0748 Validation Accuracy: 0.866600 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0743 Validation Accuracy: 0.854600 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0747 Validation Accuracy: 0.872000 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0758 Validation Accuracy: 0.884800 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0753 Validation Accuracy: 0.848800 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0751 Validation Accuracy: 0.855800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0744 Validation Accuracy: 0.876200 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0744 Validation Accuracy: 0.854800 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0772 Validation Accuracy: 0.873600 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0749 Validation Accuracy: 0.845400 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0774 Validation Accuracy: 0.861800 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.866400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0754 Validation Accuracy: 0.869800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0792 Validation Accuracy: 0.872400 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0753 Validation Accuracy: 0.863800 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0748 Validation Accuracy: 0.852200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0744 Validation Accuracy: 0.858400 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0747 Validation Accuracy: 0.878600 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0751 Validation Accuracy: 0.880200 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0745 Validation Accuracy: 0.858800 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0784 Validation Accuracy: 0.871600 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0741 Validation Accuracy: 0.883000 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0746 Validation Accuracy: 0.861000 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0774 Validation Accuracy: 0.831200 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0747 Validation Accuracy: 0.869800 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0749 Validation Accuracy: 0.855200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0767 Validation Accuracy: 0.859600 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0741 Validation Accuracy: 0.840000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0742 Validation Accuracy: 0.864000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0743 Validation Accuracy: 0.864200 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0748 Validation Accuracy: 0.874800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.873600 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0745 Validation Accuracy: 0.876400 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0739 Validation Accuracy: 0.864800 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0747 Validation Accuracy: 0.868400 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0747 Validation Accuracy: 0.845400 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.858000 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0745 Validation Accuracy: 0.872200 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0744 Validation Accuracy: 0.867600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0751 Validation Accuracy: 0.861400 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0793 Validation Accuracy: 0.871600 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0745 Validation Accuracy: 0.864400 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0765 Validation Accuracy: 0.869600 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0746 Validation Accuracy: 0.863200 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0748 Validation Accuracy: 0.861400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0754 Validation Accuracy: 0.872400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0740 Validation Accuracy: 0.880200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0750 Validation Accuracy: 0.874600 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0746 Validation Accuracy: 0.859400 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0736 Validation Accuracy: 0.872800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0745 Validation Accuracy: 0.871000 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0737 Validation Accuracy: 0.862800 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0732 Validation Accuracy: 0.895600 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0738 Validation Accuracy: 0.900600 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0732 Validation Accuracy: 0.902200 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0732 Validation Accuracy: 0.903200 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0727 Validation Accuracy: 0.903200 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0726 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0730 Validation Accuracy: 0.903200 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0726 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903800 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902400 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903800 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.902800 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904200 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904200 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903800 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902400 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903800 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.902800 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903800 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903600 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902400 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903800 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903400 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903000 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.902600 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903600 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.903800 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0725 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0729 Validation Accuracy: 0.903200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0728 Validation Accuracy: 0.904000 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0728 Validation Accuracy: 0.903600 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0725 Validation Accuracy: 0.903200
In [24]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(loss, label='training loss', color='darkorange')
plt.legend()
_ = plt.ylim()
In [25]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(acc, label='Validation accuracy', color='green')
plt.legend()
_ = plt.ylim()
In [27]:
for batch_size in [512, 256, 128, 64]:
for learning_rate_init in [0.1, 0.01, 0.001, 0.0001]:
print('Training for learning_rate={:.5f}, batch_size={} ...'.format(learning_rate_init, batch_size))
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()
with tf.Session() as sess:
steps = 0
counter = 0
learning_rate = learning_rate_init
# Initializing the variables
sess.run(tf.global_variables_initializer())
# If you want to compare training and validation, one good way to do it is to use two separate
# file writer to keep logs for each process but keep them in the same folder. This way, you can
# later view them in the same plot.
#train_log_string = 'log/train, learning_rate={:.5f}, batch_size={}'.format(learning_rate, batch_size)
valid_log_string = './tmp/log/valid, learning_rate={:.5f}, batch_size={}'.format(learning_rate_init, batch_size)
#train_filewriter = tf.summary.FileWriter(train_log_string, sess.graph)
valid_filewriter = tf.summary.FileWriter(valid_log_string, sess.graph)
# Training cycle
for epoch in range(epochs):
# Loop over all batches
n_batches = 5
if epoch >= 81:
learning_rate = learning_rate/10
if epoch >= 122:
learning_rate = learning_rate/10
for batch_i in range(1, n_batches + 1):
for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
steps += batch_features.shape[0]
counter += batch_features.shape[0]
sess.run(optimizer, feed_dict={x: batch_features, y: batch_labels,
keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1],
lr:learning_rate, is_training:True})
# Log only after the model is trained on every 1000 samples. Getting summary takes time, so the
# more frequently you look, the more extra time it'll cost you.
if counter > 1000:
#train_summ = sess.run(summary, feed_dict={x: batch_features, y: batch_labels,
# keep_prob: 1., lr:learning_rate})
#train_filewriter.add_summary(train_summ, steps)
valid_summ = sess.run(summary, feed_dict={x: valid_features, y: valid_labels,
keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:False})
valid_filewriter.add_summary(valid_summ, steps)
counter -= 1000
loss = sess.run(cost, feed_dict={x:batch_features, y:batch_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:True})
valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
lr:learning_rate, is_training:False})
print('Epoch {:>2}, CIFAR-10 Batch {}: '.format(epoch + 1, batch_i), end='')
print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
# Save Model
save_model_path = './model/image_classification(learning_rate={:.5f},batch_size={})'.format(learning_rate_init, batch_size)
saver = tf.train.Saver()
save_path = saver.save(sess, save_model_path)
Training for learning_rate=0.10000, batch_size=512 ... Epoch 1, CIFAR-10 Batch 1: Loss: 3.5629 Validation Accuracy: 0.097800 Epoch 1, CIFAR-10 Batch 2: Loss: 2.2266 Validation Accuracy: 0.106400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.9405 Validation Accuracy: 0.107200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.8566 Validation Accuracy: 0.136800 Epoch 1, CIFAR-10 Batch 5: Loss: 1.7959 Validation Accuracy: 0.118600 Epoch 2, CIFAR-10 Batch 1: Loss: 1.8690 Validation Accuracy: 0.187800 Epoch 2, CIFAR-10 Batch 2: Loss: 1.7293 Validation Accuracy: 0.117000 Epoch 2, CIFAR-10 Batch 3: Loss: 1.7036 Validation Accuracy: 0.262200 Epoch 2, CIFAR-10 Batch 4: Loss: 1.5796 Validation Accuracy: 0.213800 Epoch 2, CIFAR-10 Batch 5: Loss: 1.6553 Validation Accuracy: 0.195600 Epoch 3, CIFAR-10 Batch 1: Loss: 1.6624 Validation Accuracy: 0.184400 Epoch 3, CIFAR-10 Batch 2: Loss: 1.6190 Validation Accuracy: 0.207000 Epoch 3, CIFAR-10 Batch 3: Loss: 1.5374 Validation Accuracy: 0.254800 Epoch 3, CIFAR-10 Batch 4: Loss: 1.4454 Validation Accuracy: 0.389000 Epoch 3, CIFAR-10 Batch 5: Loss: 1.4863 Validation Accuracy: 0.250800 Epoch 4, CIFAR-10 Batch 1: Loss: 1.5600 Validation Accuracy: 0.215600 Epoch 4, CIFAR-10 Batch 2: Loss: 1.5257 Validation Accuracy: 0.400800 Epoch 4, CIFAR-10 Batch 3: Loss: 1.4522 Validation Accuracy: 0.287000 Epoch 4, CIFAR-10 Batch 4: Loss: 1.3750 Validation Accuracy: 0.255400 Epoch 4, CIFAR-10 Batch 5: Loss: 1.4091 Validation Accuracy: 0.356400 Epoch 5, CIFAR-10 Batch 1: Loss: 1.5092 Validation Accuracy: 0.301600 Epoch 5, CIFAR-10 Batch 2: Loss: 1.4384 Validation Accuracy: 0.382000 Epoch 5, CIFAR-10 Batch 3: Loss: 1.3971 Validation Accuracy: 0.328000 Epoch 5, CIFAR-10 Batch 4: Loss: 1.3448 Validation Accuracy: 0.296400 Epoch 5, CIFAR-10 Batch 5: Loss: 1.3701 Validation Accuracy: 0.299200 Epoch 6, CIFAR-10 Batch 1: Loss: 1.4102 Validation Accuracy: 0.265800 Epoch 6, CIFAR-10 Batch 2: Loss: 1.4003 Validation Accuracy: 0.357400 Epoch 6, CIFAR-10 Batch 3: Loss: 1.3888 Validation Accuracy: 0.333800 Epoch 6, CIFAR-10 Batch 4: Loss: 1.2992 Validation Accuracy: 0.451400 Epoch 6, CIFAR-10 Batch 5: Loss: 1.3864 Validation Accuracy: 0.383400 Epoch 7, CIFAR-10 Batch 1: Loss: 1.3947 Validation Accuracy: 0.368800 Epoch 7, CIFAR-10 Batch 2: Loss: 1.2217 Validation Accuracy: 0.329000 Epoch 7, CIFAR-10 Batch 3: Loss: 1.1433 Validation Accuracy: 0.244200 Epoch 7, CIFAR-10 Batch 4: Loss: 1.1549 Validation Accuracy: 0.198800 Epoch 7, CIFAR-10 Batch 5: Loss: 1.1471 Validation Accuracy: 0.365200 Epoch 8, CIFAR-10 Batch 1: Loss: 1.2275 Validation Accuracy: 0.406200 Epoch 8, CIFAR-10 Batch 2: Loss: 1.1440 Validation Accuracy: 0.416800 Epoch 8, CIFAR-10 Batch 3: Loss: 1.1479 Validation Accuracy: 0.242600 Epoch 8, CIFAR-10 Batch 4: Loss: 1.0834 Validation Accuracy: 0.434400 Epoch 8, CIFAR-10 Batch 5: Loss: 1.1315 Validation Accuracy: 0.496000 Epoch 9, CIFAR-10 Batch 1: Loss: 1.2019 Validation Accuracy: 0.385800 Epoch 9, CIFAR-10 Batch 2: Loss: 1.1313 Validation Accuracy: 0.368600 Epoch 9, CIFAR-10 Batch 3: Loss: 1.1532 Validation Accuracy: 0.495800 Epoch 9, CIFAR-10 Batch 4: Loss: 1.0834 Validation Accuracy: 0.482400 Epoch 9, CIFAR-10 Batch 5: Loss: 1.0273 Validation Accuracy: 0.409600 Epoch 10, CIFAR-10 Batch 1: Loss: 1.1861 Validation Accuracy: 0.421000 Epoch 10, CIFAR-10 Batch 2: Loss: 1.0668 Validation Accuracy: 0.258800 Epoch 10, CIFAR-10 Batch 3: Loss: 1.0839 Validation Accuracy: 0.363000 Epoch 10, CIFAR-10 Batch 4: Loss: 1.0455 Validation Accuracy: 0.441400 Epoch 10, CIFAR-10 Batch 5: Loss: 1.0302 Validation Accuracy: 0.472600 Epoch 11, CIFAR-10 Batch 1: Loss: 1.1497 Validation Accuracy: 0.470000 Epoch 11, CIFAR-10 Batch 2: Loss: 1.0419 Validation Accuracy: 0.499600 Epoch 11, CIFAR-10 Batch 3: Loss: 0.9999 Validation Accuracy: 0.483200 Epoch 11, CIFAR-10 Batch 4: Loss: 1.0078 Validation Accuracy: 0.469400 Epoch 11, CIFAR-10 Batch 5: Loss: 1.0181 Validation Accuracy: 0.509800 Epoch 12, CIFAR-10 Batch 1: Loss: 1.1348 Validation Accuracy: 0.450400 Epoch 12, CIFAR-10 Batch 2: Loss: 1.0014 Validation Accuracy: 0.369600 Epoch 12, CIFAR-10 Batch 3: Loss: 0.9975 Validation Accuracy: 0.403200 Epoch 12, CIFAR-10 Batch 4: Loss: 0.9769 Validation Accuracy: 0.448000 Epoch 12, CIFAR-10 Batch 5: Loss: 1.0136 Validation Accuracy: 0.482400 Epoch 13, CIFAR-10 Batch 1: Loss: 1.0770 Validation Accuracy: 0.466000 Epoch 13, CIFAR-10 Batch 2: Loss: 0.9745 Validation Accuracy: 0.419600 Epoch 13, CIFAR-10 Batch 3: Loss: 0.9667 Validation Accuracy: 0.517600 Epoch 13, CIFAR-10 Batch 4: Loss: 0.9709 Validation Accuracy: 0.477800 Epoch 13, CIFAR-10 Batch 5: Loss: 0.9573 Validation Accuracy: 0.542000 Epoch 14, CIFAR-10 Batch 1: Loss: 1.0719 Validation Accuracy: 0.185400 Epoch 14, CIFAR-10 Batch 2: Loss: 0.9923 Validation Accuracy: 0.336400 Epoch 14, CIFAR-10 Batch 3: Loss: 0.9501 Validation Accuracy: 0.536600 Epoch 14, CIFAR-10 Batch 4: Loss: 0.9081 Validation Accuracy: 0.529200 Epoch 14, CIFAR-10 Batch 5: Loss: 0.9239 Validation Accuracy: 0.539200 Epoch 15, CIFAR-10 Batch 1: Loss: 1.0309 Validation Accuracy: 0.490000 Epoch 15, CIFAR-10 Batch 2: Loss: 0.9611 Validation Accuracy: 0.566600 Epoch 15, CIFAR-10 Batch 3: Loss: 0.9244 Validation Accuracy: 0.617200 Epoch 15, CIFAR-10 Batch 4: Loss: 0.8843 Validation Accuracy: 0.438600 Epoch 15, CIFAR-10 Batch 5: Loss: 0.9348 Validation Accuracy: 0.474200 Epoch 16, CIFAR-10 Batch 1: Loss: 1.0426 Validation Accuracy: 0.469400 Epoch 16, CIFAR-10 Batch 2: Loss: 0.9108 Validation Accuracy: 0.509200 Epoch 16, CIFAR-10 Batch 3: Loss: 0.9373 Validation Accuracy: 0.520000 Epoch 16, CIFAR-10 Batch 4: Loss: 0.8873 Validation Accuracy: 0.552800 Epoch 16, CIFAR-10 Batch 5: Loss: 0.9063 Validation Accuracy: 0.519600 Epoch 17, CIFAR-10 Batch 1: Loss: 1.0416 Validation Accuracy: 0.267800 Epoch 17, CIFAR-10 Batch 2: Loss: 0.9102 Validation Accuracy: 0.541600 Epoch 17, CIFAR-10 Batch 3: Loss: 0.9129 Validation Accuracy: 0.452000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.8790 Validation Accuracy: 0.590400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.9102 Validation Accuracy: 0.274200 Epoch 18, CIFAR-10 Batch 1: Loss: 1.0182 Validation Accuracy: 0.487400 Epoch 18, CIFAR-10 Batch 2: Loss: 0.9048 Validation Accuracy: 0.311000 Epoch 18, CIFAR-10 Batch 3: Loss: 0.8855 Validation Accuracy: 0.399600 Epoch 18, CIFAR-10 Batch 4: Loss: 0.8520 Validation Accuracy: 0.488000 Epoch 18, CIFAR-10 Batch 5: Loss: 0.8702 Validation Accuracy: 0.528200 Epoch 19, CIFAR-10 Batch 1: Loss: 1.0161 Validation Accuracy: 0.510600 Epoch 19, CIFAR-10 Batch 2: Loss: 0.8820 Validation Accuracy: 0.543000 Epoch 19, CIFAR-10 Batch 3: Loss: 0.8892 Validation Accuracy: 0.487800 Epoch 19, CIFAR-10 Batch 4: Loss: 0.8653 Validation Accuracy: 0.370400 Epoch 19, CIFAR-10 Batch 5: Loss: 0.8496 Validation Accuracy: 0.442600 Epoch 20, CIFAR-10 Batch 1: Loss: 0.9585 Validation Accuracy: 0.522200 Epoch 20, CIFAR-10 Batch 2: Loss: 0.8934 Validation Accuracy: 0.470400 Epoch 20, CIFAR-10 Batch 3: Loss: 0.9047 Validation Accuracy: 0.357000 Epoch 20, CIFAR-10 Batch 4: Loss: 0.8583 Validation Accuracy: 0.535600 Epoch 20, CIFAR-10 Batch 5: Loss: 0.8443 Validation Accuracy: 0.567800 Epoch 21, CIFAR-10 Batch 1: Loss: 0.9798 Validation Accuracy: 0.563800 Epoch 21, CIFAR-10 Batch 2: Loss: 0.8710 Validation Accuracy: 0.551000 Epoch 21, CIFAR-10 Batch 3: Loss: 0.8807 Validation Accuracy: 0.517600 Epoch 21, CIFAR-10 Batch 4: Loss: 0.8387 Validation Accuracy: 0.564600 Epoch 21, CIFAR-10 Batch 5: Loss: 0.8688 Validation Accuracy: 0.564400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.9316 Validation Accuracy: 0.569200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.8483 Validation Accuracy: 0.523400 Epoch 22, CIFAR-10 Batch 3: Loss: 0.8713 Validation Accuracy: 0.491800 Epoch 22, CIFAR-10 Batch 4: Loss: 0.8198 Validation Accuracy: 0.475800 Epoch 22, CIFAR-10 Batch 5: Loss: 0.8307 Validation Accuracy: 0.566600 Epoch 23, CIFAR-10 Batch 1: Loss: 0.9640 Validation Accuracy: 0.531600 Epoch 23, CIFAR-10 Batch 2: Loss: 0.8367 Validation Accuracy: 0.500000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.8515 Validation Accuracy: 0.491400 Epoch 23, CIFAR-10 Batch 4: Loss: 0.8142 Validation Accuracy: 0.304000 Epoch 23, CIFAR-10 Batch 5: Loss: 0.8475 Validation Accuracy: 0.565000 Epoch 24, CIFAR-10 Batch 1: Loss: 0.9323 Validation Accuracy: 0.538800 Epoch 24, CIFAR-10 Batch 2: Loss: 0.8259 Validation Accuracy: 0.413000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.8270 Validation Accuracy: 0.525800 Epoch 24, CIFAR-10 Batch 4: Loss: 0.8468 Validation Accuracy: 0.586400 Epoch 24, CIFAR-10 Batch 5: Loss: 0.8565 Validation Accuracy: 0.523200 Epoch 25, CIFAR-10 Batch 1: Loss: 0.8904 Validation Accuracy: 0.624000 Epoch 25, CIFAR-10 Batch 2: Loss: 0.8238 Validation Accuracy: 0.510800 Epoch 25, CIFAR-10 Batch 3: Loss: 0.8330 Validation Accuracy: 0.411400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.8192 Validation Accuracy: 0.538400 Epoch 25, CIFAR-10 Batch 5: Loss: 0.7898 Validation Accuracy: 0.492600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.9203 Validation Accuracy: 0.643200 Epoch 26, CIFAR-10 Batch 2: Loss: 0.8153 Validation Accuracy: 0.546800 Epoch 26, CIFAR-10 Batch 3: Loss: 0.8534 Validation Accuracy: 0.534400 Epoch 26, CIFAR-10 Batch 4: Loss: 0.8218 Validation Accuracy: 0.626000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.8050 Validation Accuracy: 0.594400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.9427 Validation Accuracy: 0.430800 Epoch 27, CIFAR-10 Batch 2: Loss: 0.8149 Validation Accuracy: 0.560600 Epoch 27, CIFAR-10 Batch 3: Loss: 0.8122 Validation Accuracy: 0.650600 Epoch 27, CIFAR-10 Batch 4: Loss: 0.7644 Validation Accuracy: 0.564800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.7719 Validation Accuracy: 0.530600 Epoch 28, CIFAR-10 Batch 1: Loss: 0.8935 Validation Accuracy: 0.339200 Epoch 28, CIFAR-10 Batch 2: Loss: 0.7791 Validation Accuracy: 0.609200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.8379 Validation Accuracy: 0.538200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.7794 Validation Accuracy: 0.576600 Epoch 28, CIFAR-10 Batch 5: Loss: 0.8038 Validation Accuracy: 0.543400 Epoch 29, CIFAR-10 Batch 1: Loss: 0.8742 Validation Accuracy: 0.476800 Epoch 29, CIFAR-10 Batch 2: Loss: 0.7713 Validation Accuracy: 0.510800 Epoch 29, CIFAR-10 Batch 3: Loss: 0.7909 Validation Accuracy: 0.537200 Epoch 29, CIFAR-10 Batch 4: Loss: 0.7594 Validation Accuracy: 0.434400 Epoch 29, CIFAR-10 Batch 5: Loss: 0.7857 Validation Accuracy: 0.622000 Epoch 30, CIFAR-10 Batch 1: Loss: 0.8834 Validation Accuracy: 0.552200 Epoch 30, CIFAR-10 Batch 2: Loss: 0.8293 Validation Accuracy: 0.612400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.8116 Validation Accuracy: 0.589600 Epoch 30, CIFAR-10 Batch 4: Loss: 0.7671 Validation Accuracy: 0.598600 Epoch 30, CIFAR-10 Batch 5: Loss: 0.8299 Validation Accuracy: 0.586400 Epoch 31, CIFAR-10 Batch 1: Loss: 0.8713 Validation Accuracy: 0.548200 Epoch 31, CIFAR-10 Batch 2: Loss: 0.8046 Validation Accuracy: 0.450200 Epoch 31, CIFAR-10 Batch 3: Loss: 0.8346 Validation Accuracy: 0.616200 Epoch 31, CIFAR-10 Batch 4: Loss: 0.7521 Validation Accuracy: 0.607400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.8050 Validation Accuracy: 0.528400 Epoch 32, CIFAR-10 Batch 1: Loss: 0.9014 Validation Accuracy: 0.543000 Epoch 32, CIFAR-10 Batch 2: Loss: 0.7660 Validation Accuracy: 0.529400 Epoch 32, CIFAR-10 Batch 3: Loss: 0.7639 Validation Accuracy: 0.591200 Epoch 32, CIFAR-10 Batch 4: Loss: 0.7652 Validation Accuracy: 0.591200 Epoch 32, CIFAR-10 Batch 5: Loss: 0.7657 Validation Accuracy: 0.401200 Epoch 33, CIFAR-10 Batch 1: Loss: 0.8410 Validation Accuracy: 0.606600 Epoch 33, CIFAR-10 Batch 2: Loss: 0.7651 Validation Accuracy: 0.347000 Epoch 33, CIFAR-10 Batch 3: Loss: 0.7959 Validation Accuracy: 0.459200 Epoch 33, CIFAR-10 Batch 4: Loss: 0.7402 Validation Accuracy: 0.584800 Epoch 33, CIFAR-10 Batch 5: Loss: 0.7288 Validation Accuracy: 0.610800 Epoch 34, CIFAR-10 Batch 1: Loss: 0.8297 Validation Accuracy: 0.510400 Epoch 34, CIFAR-10 Batch 2: Loss: 0.8063 Validation Accuracy: 0.611800 Epoch 34, CIFAR-10 Batch 3: Loss: 0.7710 Validation Accuracy: 0.433000 Epoch 34, CIFAR-10 Batch 4: Loss: 0.7452 Validation Accuracy: 0.609000 Epoch 34, CIFAR-10 Batch 5: Loss: 0.7551 Validation Accuracy: 0.497400 Epoch 35, CIFAR-10 Batch 1: Loss: 0.8272 Validation Accuracy: 0.514200 Epoch 35, CIFAR-10 Batch 2: Loss: 0.7613 Validation Accuracy: 0.547800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.7810 Validation Accuracy: 0.477400 Epoch 35, CIFAR-10 Batch 4: Loss: 0.7555 Validation Accuracy: 0.474600 Epoch 35, CIFAR-10 Batch 5: Loss: 0.7953 Validation Accuracy: 0.551600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.8090 Validation Accuracy: 0.559600 Epoch 36, CIFAR-10 Batch 2: Loss: 0.7534 Validation Accuracy: 0.603400 Epoch 36, CIFAR-10 Batch 3: Loss: 0.7714 Validation Accuracy: 0.460000 Epoch 36, CIFAR-10 Batch 4: Loss: 0.7268 Validation Accuracy: 0.638400 Epoch 36, CIFAR-10 Batch 5: Loss: 0.7652 Validation Accuracy: 0.626400 Epoch 37, CIFAR-10 Batch 1: Loss: 0.8436 Validation Accuracy: 0.533200 Epoch 37, CIFAR-10 Batch 2: Loss: 0.7491 Validation Accuracy: 0.568200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.7706 Validation Accuracy: 0.526600 Epoch 37, CIFAR-10 Batch 4: Loss: 0.7397 Validation Accuracy: 0.596400 Epoch 37, CIFAR-10 Batch 5: Loss: 0.7563 Validation Accuracy: 0.584800 Epoch 38, CIFAR-10 Batch 1: Loss: 0.8533 Validation Accuracy: 0.592400 Epoch 38, CIFAR-10 Batch 2: Loss: 0.7480 Validation Accuracy: 0.604200 Epoch 38, CIFAR-10 Batch 3: Loss: 0.7352 Validation Accuracy: 0.633600 Epoch 38, CIFAR-10 Batch 4: Loss: 0.7214 Validation Accuracy: 0.651400 Epoch 38, CIFAR-10 Batch 5: Loss: 0.7350 Validation Accuracy: 0.598600 Epoch 39, CIFAR-10 Batch 1: Loss: 0.8164 Validation Accuracy: 0.636400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.7447 Validation Accuracy: 0.396400 Epoch 39, CIFAR-10 Batch 3: Loss: 0.7464 Validation Accuracy: 0.489000 Epoch 39, CIFAR-10 Batch 4: Loss: 0.7290 Validation Accuracy: 0.469600 Epoch 39, CIFAR-10 Batch 5: Loss: 0.7764 Validation Accuracy: 0.642800 Epoch 40, CIFAR-10 Batch 1: Loss: 0.8309 Validation Accuracy: 0.586600 Epoch 40, CIFAR-10 Batch 2: Loss: 0.7394 Validation Accuracy: 0.599000 Epoch 40, CIFAR-10 Batch 3: Loss: 0.7291 Validation Accuracy: 0.486200 Epoch 40, CIFAR-10 Batch 4: Loss: 0.7057 Validation Accuracy: 0.591400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.7302 Validation Accuracy: 0.618800 Epoch 41, CIFAR-10 Batch 1: Loss: 0.8249 Validation Accuracy: 0.603400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.7193 Validation Accuracy: 0.540400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.7625 Validation Accuracy: 0.469400 Epoch 41, CIFAR-10 Batch 4: Loss: 0.6925 Validation Accuracy: 0.620800 Epoch 41, CIFAR-10 Batch 5: Loss: 0.7195 Validation Accuracy: 0.403000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.8117 Validation Accuracy: 0.596800 Epoch 42, CIFAR-10 Batch 2: Loss: 0.7459 Validation Accuracy: 0.629600 Epoch 42, CIFAR-10 Batch 3: Loss: 0.7303 Validation Accuracy: 0.575800 Epoch 42, CIFAR-10 Batch 4: Loss: 0.7160 Validation Accuracy: 0.652000 Epoch 42, CIFAR-10 Batch 5: Loss: 0.7378 Validation Accuracy: 0.600600 Epoch 43, CIFAR-10 Batch 1: Loss: 0.8046 Validation Accuracy: 0.446800 Epoch 43, CIFAR-10 Batch 2: Loss: 0.7263 Validation Accuracy: 0.534400 Epoch 43, CIFAR-10 Batch 3: Loss: 0.7494 Validation Accuracy: 0.548200 Epoch 43, CIFAR-10 Batch 4: Loss: 0.7201 Validation Accuracy: 0.650200 Epoch 43, CIFAR-10 Batch 5: Loss: 0.7457 Validation Accuracy: 0.468400 Epoch 44, CIFAR-10 Batch 1: Loss: 0.8042 Validation Accuracy: 0.629200 Epoch 44, CIFAR-10 Batch 2: Loss: 0.7359 Validation Accuracy: 0.501400 Epoch 44, CIFAR-10 Batch 3: Loss: 0.7334 Validation Accuracy: 0.438200 Epoch 44, CIFAR-10 Batch 4: Loss: 0.7275 Validation Accuracy: 0.572800 Epoch 44, CIFAR-10 Batch 5: Loss: 0.7758 Validation Accuracy: 0.523800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.7934 Validation Accuracy: 0.580400 Epoch 45, CIFAR-10 Batch 2: Loss: 0.7071 Validation Accuracy: 0.627600 Epoch 45, CIFAR-10 Batch 3: Loss: 0.7400 Validation Accuracy: 0.570200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.7262 Validation Accuracy: 0.567200 Epoch 45, CIFAR-10 Batch 5: Loss: 0.7201 Validation Accuracy: 0.508400 Epoch 46, CIFAR-10 Batch 1: Loss: 0.8025 Validation Accuracy: 0.631200 Epoch 46, CIFAR-10 Batch 2: Loss: 0.7179 Validation Accuracy: 0.547800 Epoch 46, CIFAR-10 Batch 3: Loss: 0.7465 Validation Accuracy: 0.609800 Epoch 46, CIFAR-10 Batch 4: Loss: 0.7202 Validation Accuracy: 0.640600 Epoch 46, CIFAR-10 Batch 5: Loss: 0.7163 Validation Accuracy: 0.584400 Epoch 47, CIFAR-10 Batch 1: Loss: 0.8018 Validation Accuracy: 0.419400 Epoch 47, CIFAR-10 Batch 2: Loss: 0.7109 Validation Accuracy: 0.560600 Epoch 47, CIFAR-10 Batch 3: Loss: 0.7274 Validation Accuracy: 0.548800 Epoch 47, CIFAR-10 Batch 4: Loss: 0.7086 Validation Accuracy: 0.521800 Epoch 47, CIFAR-10 Batch 5: Loss: 0.6976 Validation Accuracy: 0.602200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.7782 Validation Accuracy: 0.512000 Epoch 48, CIFAR-10 Batch 2: Loss: 0.7112 Validation Accuracy: 0.565400 Epoch 48, CIFAR-10 Batch 3: Loss: 0.7382 Validation Accuracy: 0.557800 Epoch 48, CIFAR-10 Batch 4: Loss: 0.6721 Validation Accuracy: 0.576200 Epoch 48, CIFAR-10 Batch 5: Loss: 0.7096 Validation Accuracy: 0.572400 Epoch 49, CIFAR-10 Batch 1: Loss: 0.7595 Validation Accuracy: 0.592400 Epoch 49, CIFAR-10 Batch 2: Loss: 0.6903 Validation Accuracy: 0.578000 Epoch 49, CIFAR-10 Batch 3: Loss: 0.7218 Validation Accuracy: 0.647800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.6658 Validation Accuracy: 0.562200 Epoch 49, CIFAR-10 Batch 5: Loss: 0.7140 Validation Accuracy: 0.554200 Epoch 50, CIFAR-10 Batch 1: Loss: 0.7929 Validation Accuracy: 0.540000 Epoch 50, CIFAR-10 Batch 2: Loss: 0.7136 Validation Accuracy: 0.570600 Epoch 50, CIFAR-10 Batch 3: Loss: 0.7288 Validation Accuracy: 0.593200 Epoch 50, CIFAR-10 Batch 4: Loss: 0.6986 Validation Accuracy: 0.597000 Epoch 50, CIFAR-10 Batch 5: Loss: 0.6993 Validation Accuracy: 0.649200 Epoch 51, CIFAR-10 Batch 1: Loss: 0.7763 Validation Accuracy: 0.664800 Epoch 51, CIFAR-10 Batch 2: Loss: 0.6818 Validation Accuracy: 0.503400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.7209 Validation Accuracy: 0.486000 Epoch 51, CIFAR-10 Batch 4: Loss: 0.6769 Validation Accuracy: 0.591400 Epoch 51, CIFAR-10 Batch 5: Loss: 0.7314 Validation Accuracy: 0.578800 Epoch 52, CIFAR-10 Batch 1: Loss: 0.7934 Validation Accuracy: 0.601200 Epoch 52, CIFAR-10 Batch 2: Loss: 0.7349 Validation Accuracy: 0.625000 Epoch 52, CIFAR-10 Batch 3: Loss: 0.7166 Validation Accuracy: 0.455800 Epoch 52, CIFAR-10 Batch 4: Loss: 0.6934 Validation Accuracy: 0.620200 Epoch 52, CIFAR-10 Batch 5: Loss: 0.7053 Validation Accuracy: 0.451800 Epoch 53, CIFAR-10 Batch 1: Loss: 0.7499 Validation Accuracy: 0.561000 Epoch 53, CIFAR-10 Batch 2: Loss: 0.7008 Validation Accuracy: 0.665000 Epoch 53, CIFAR-10 Batch 3: Loss: 0.7348 Validation Accuracy: 0.574200 Epoch 53, CIFAR-10 Batch 4: Loss: 0.6639 Validation Accuracy: 0.616200 Epoch 53, CIFAR-10 Batch 5: Loss: 0.7127 Validation Accuracy: 0.591000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.7530 Validation Accuracy: 0.578600 Epoch 54, CIFAR-10 Batch 2: Loss: 0.6881 Validation Accuracy: 0.656400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.6813 Validation Accuracy: 0.602800 Epoch 54, CIFAR-10 Batch 4: Loss: 0.6628 Validation Accuracy: 0.511400 Epoch 54, CIFAR-10 Batch 5: Loss: 0.7283 Validation Accuracy: 0.474200 Epoch 55, CIFAR-10 Batch 1: Loss: 0.7633 Validation Accuracy: 0.662600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.7045 Validation Accuracy: 0.634000 Epoch 55, CIFAR-10 Batch 3: Loss: 0.7032 Validation Accuracy: 0.496600 Epoch 55, CIFAR-10 Batch 4: Loss: 0.6629 Validation Accuracy: 0.631200 Epoch 55, CIFAR-10 Batch 5: Loss: 0.7120 Validation Accuracy: 0.648200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.7550 Validation Accuracy: 0.604800 Epoch 56, CIFAR-10 Batch 2: Loss: 0.7064 Validation Accuracy: 0.644000 Epoch 56, CIFAR-10 Batch 3: Loss: 0.7234 Validation Accuracy: 0.640400 Epoch 56, CIFAR-10 Batch 4: Loss: 0.6442 Validation Accuracy: 0.675400 Epoch 56, CIFAR-10 Batch 5: Loss: 0.6884 Validation Accuracy: 0.584000 Epoch 57, CIFAR-10 Batch 1: Loss: 0.7664 Validation Accuracy: 0.586800 Epoch 57, CIFAR-10 Batch 2: Loss: 0.7014 Validation Accuracy: 0.570600 Epoch 57, CIFAR-10 Batch 3: Loss: 0.7015 Validation Accuracy: 0.490800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.6734 Validation Accuracy: 0.634800 Epoch 57, CIFAR-10 Batch 5: Loss: 0.7195 Validation Accuracy: 0.586800 Epoch 58, CIFAR-10 Batch 1: Loss: 0.7463 Validation Accuracy: 0.669600 Epoch 58, CIFAR-10 Batch 2: Loss: 0.6917 Validation Accuracy: 0.607800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.6829 Validation Accuracy: 0.617000 Epoch 58, CIFAR-10 Batch 4: Loss: 0.6770 Validation Accuracy: 0.511800 Epoch 58, CIFAR-10 Batch 5: Loss: 0.6928 Validation Accuracy: 0.604200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.7790 Validation Accuracy: 0.653000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.6616 Validation Accuracy: 0.671400 Epoch 59, CIFAR-10 Batch 3: Loss: 0.7011 Validation Accuracy: 0.610600 Epoch 59, CIFAR-10 Batch 4: Loss: 0.6406 Validation Accuracy: 0.639000 Epoch 59, CIFAR-10 Batch 5: Loss: 0.6655 Validation Accuracy: 0.616600 Epoch 60, CIFAR-10 Batch 1: Loss: 0.7516 Validation Accuracy: 0.553400 Epoch 60, CIFAR-10 Batch 2: Loss: 0.6597 Validation Accuracy: 0.671400 Epoch 60, CIFAR-10 Batch 3: Loss: 0.7008 Validation Accuracy: 0.484600 Epoch 60, CIFAR-10 Batch 4: Loss: 0.6338 Validation Accuracy: 0.578200 Epoch 60, CIFAR-10 Batch 5: Loss: 0.6746 Validation Accuracy: 0.618000 Epoch 61, CIFAR-10 Batch 1: Loss: 0.7453 Validation Accuracy: 0.656200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.6836 Validation Accuracy: 0.630200 Epoch 61, CIFAR-10 Batch 3: Loss: 0.6732 Validation Accuracy: 0.672000 Epoch 61, CIFAR-10 Batch 4: Loss: 0.6445 Validation Accuracy: 0.664000 Epoch 61, CIFAR-10 Batch 5: Loss: 0.6780 Validation Accuracy: 0.565600 Epoch 62, CIFAR-10 Batch 1: Loss: 0.7546 Validation Accuracy: 0.517200 Epoch 62, CIFAR-10 Batch 2: Loss: 0.6712 Validation Accuracy: 0.612400 Epoch 62, CIFAR-10 Batch 3: Loss: 0.6765 Validation Accuracy: 0.590200 Epoch 62, CIFAR-10 Batch 4: Loss: 0.6527 Validation Accuracy: 0.595200 Epoch 62, CIFAR-10 Batch 5: Loss: 0.6840 Validation Accuracy: 0.587200 Epoch 63, CIFAR-10 Batch 1: Loss: 0.7312 Validation Accuracy: 0.618600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.6720 Validation Accuracy: 0.635000 Epoch 63, CIFAR-10 Batch 3: Loss: 0.6771 Validation Accuracy: 0.521200 Epoch 63, CIFAR-10 Batch 4: Loss: 0.6769 Validation Accuracy: 0.541800 Epoch 63, CIFAR-10 Batch 5: Loss: 0.6665 Validation Accuracy: 0.679800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.7625 Validation Accuracy: 0.575200 Epoch 64, CIFAR-10 Batch 2: Loss: 0.6508 Validation Accuracy: 0.613000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.6958 Validation Accuracy: 0.474400 Epoch 64, CIFAR-10 Batch 4: Loss: 0.6440 Validation Accuracy: 0.590200 Epoch 64, CIFAR-10 Batch 5: Loss: 0.6657 Validation Accuracy: 0.676800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.7742 Validation Accuracy: 0.540200 Epoch 65, CIFAR-10 Batch 2: Loss: 0.6387 Validation Accuracy: 0.686800 Epoch 65, CIFAR-10 Batch 3: Loss: 0.7102 Validation Accuracy: 0.517800 Epoch 65, CIFAR-10 Batch 4: Loss: 0.6719 Validation Accuracy: 0.675400 Epoch 65, CIFAR-10 Batch 5: Loss: 0.6800 Validation Accuracy: 0.587400 Epoch 66, CIFAR-10 Batch 1: Loss: 0.7604 Validation Accuracy: 0.560200 Epoch 66, CIFAR-10 Batch 2: Loss: 0.6588 Validation Accuracy: 0.707400 Epoch 66, CIFAR-10 Batch 3: Loss: 0.6899 Validation Accuracy: 0.562400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.6584 Validation Accuracy: 0.610000 Epoch 66, CIFAR-10 Batch 5: Loss: 0.6526 Validation Accuracy: 0.581400 Epoch 67, CIFAR-10 Batch 1: Loss: 0.7691 Validation Accuracy: 0.528800 Epoch 67, CIFAR-10 Batch 2: Loss: 0.6683 Validation Accuracy: 0.584400 Epoch 67, CIFAR-10 Batch 3: Loss: 0.6893 Validation Accuracy: 0.485800 Epoch 67, CIFAR-10 Batch 4: Loss: 0.6311 Validation Accuracy: 0.555800 Epoch 67, CIFAR-10 Batch 5: Loss: 0.6617 Validation Accuracy: 0.390200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.7587 Validation Accuracy: 0.546400 Epoch 68, CIFAR-10 Batch 2: Loss: 0.6608 Validation Accuracy: 0.569000 Epoch 68, CIFAR-10 Batch 3: Loss: 0.6597 Validation Accuracy: 0.519000 Epoch 68, CIFAR-10 Batch 4: Loss: 0.6633 Validation Accuracy: 0.594400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.6514 Validation Accuracy: 0.558200 Epoch 69, CIFAR-10 Batch 1: Loss: 0.7090 Validation Accuracy: 0.660000 Epoch 69, CIFAR-10 Batch 2: Loss: 0.6683 Validation Accuracy: 0.614400 Epoch 69, CIFAR-10 Batch 3: Loss: 0.6868 Validation Accuracy: 0.630200 Epoch 69, CIFAR-10 Batch 4: Loss: 0.6790 Validation Accuracy: 0.635200 Epoch 69, CIFAR-10 Batch 5: Loss: 0.6820 Validation Accuracy: 0.642000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.7317 Validation Accuracy: 0.541200 Epoch 70, CIFAR-10 Batch 2: Loss: 0.7052 Validation Accuracy: 0.428800 Epoch 70, CIFAR-10 Batch 3: Loss: 0.6838 Validation Accuracy: 0.592800 Epoch 70, CIFAR-10 Batch 4: Loss: 0.6488 Validation Accuracy: 0.620400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.6807 Validation Accuracy: 0.638800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.7381 Validation Accuracy: 0.670000 Epoch 71, CIFAR-10 Batch 2: Loss: 0.6742 Validation Accuracy: 0.613800 Epoch 71, CIFAR-10 Batch 3: Loss: 0.6754 Validation Accuracy: 0.456200 Epoch 71, CIFAR-10 Batch 4: Loss: 0.6492 Validation Accuracy: 0.640800 Epoch 71, CIFAR-10 Batch 5: Loss: 0.6251 Validation Accuracy: 0.654800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.6933 Validation Accuracy: 0.509000 Epoch 72, CIFAR-10 Batch 2: Loss: 0.6933 Validation Accuracy: 0.636000 Epoch 72, CIFAR-10 Batch 3: Loss: 0.6968 Validation Accuracy: 0.608200 Epoch 72, CIFAR-10 Batch 4: Loss: 0.6307 Validation Accuracy: 0.685000 Epoch 72, CIFAR-10 Batch 5: Loss: 0.6907 Validation Accuracy: 0.605400 Epoch 73, CIFAR-10 Batch 1: Loss: 0.7005 Validation Accuracy: 0.602400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.6818 Validation Accuracy: 0.559800 Epoch 73, CIFAR-10 Batch 3: Loss: 0.6979 Validation Accuracy: 0.658600 Epoch 73, CIFAR-10 Batch 4: Loss: 0.6369 Validation Accuracy: 0.631200 Epoch 73, CIFAR-10 Batch 5: Loss: 0.6630 Validation Accuracy: 0.649200 Epoch 74, CIFAR-10 Batch 1: Loss: 0.7307 Validation Accuracy: 0.656800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.6279 Validation Accuracy: 0.643200 Epoch 74, CIFAR-10 Batch 3: Loss: 0.6785 Validation Accuracy: 0.626800 Epoch 74, CIFAR-10 Batch 4: Loss: 0.6434 Validation Accuracy: 0.578200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.6589 Validation Accuracy: 0.624000 Epoch 75, CIFAR-10 Batch 1: Loss: 0.7346 Validation Accuracy: 0.599000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.6555 Validation Accuracy: 0.588200 Epoch 75, CIFAR-10 Batch 3: Loss: 0.6925 Validation Accuracy: 0.548200 Epoch 75, CIFAR-10 Batch 4: Loss: 0.6434 Validation Accuracy: 0.657000 Epoch 75, CIFAR-10 Batch 5: Loss: 0.6584 Validation Accuracy: 0.583000 Epoch 76, CIFAR-10 Batch 1: Loss: 0.7391 Validation Accuracy: 0.599000 Epoch 76, CIFAR-10 Batch 2: Loss: 0.6589 Validation Accuracy: 0.442600 Epoch 76, CIFAR-10 Batch 3: Loss: 0.6474 Validation Accuracy: 0.482400 Epoch 76, CIFAR-10 Batch 4: Loss: 0.6188 Validation Accuracy: 0.684200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.6319 Validation Accuracy: 0.601800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.7124 Validation Accuracy: 0.615800 Epoch 77, CIFAR-10 Batch 2: Loss: 0.6626 Validation Accuracy: 0.610600 Epoch 77, CIFAR-10 Batch 3: Loss: 0.6641 Validation Accuracy: 0.581000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.6543 Validation Accuracy: 0.657600 Epoch 77, CIFAR-10 Batch 5: Loss: 0.6532 Validation Accuracy: 0.544600 Epoch 78, CIFAR-10 Batch 1: Loss: 0.7326 Validation Accuracy: 0.566000 Epoch 78, CIFAR-10 Batch 2: Loss: 0.6709 Validation Accuracy: 0.689000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.6618 Validation Accuracy: 0.540600 Epoch 78, CIFAR-10 Batch 4: Loss: 0.6355 Validation Accuracy: 0.589200 Epoch 78, CIFAR-10 Batch 5: Loss: 0.6385 Validation Accuracy: 0.611400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.7190 Validation Accuracy: 0.482800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.627600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.6731 Validation Accuracy: 0.634800 Epoch 79, CIFAR-10 Batch 4: Loss: 0.6406 Validation Accuracy: 0.651800 Epoch 79, CIFAR-10 Batch 5: Loss: 0.6265 Validation Accuracy: 0.661800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.7059 Validation Accuracy: 0.630400 Epoch 80, CIFAR-10 Batch 2: Loss: 0.6364 Validation Accuracy: 0.593400 Epoch 80, CIFAR-10 Batch 3: Loss: 0.6843 Validation Accuracy: 0.419400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.6455 Validation Accuracy: 0.576200 Epoch 80, CIFAR-10 Batch 5: Loss: 0.6576 Validation Accuracy: 0.596200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.7056 Validation Accuracy: 0.591400 Epoch 81, CIFAR-10 Batch 2: Loss: 0.6510 Validation Accuracy: 0.494800 Epoch 81, CIFAR-10 Batch 3: Loss: 0.6727 Validation Accuracy: 0.663800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.6197 Validation Accuracy: 0.689200 Epoch 81, CIFAR-10 Batch 5: Loss: 0.6357 Validation Accuracy: 0.679400 Epoch 82, CIFAR-10 Batch 1: Loss: 0.7160 Validation Accuracy: 0.708400 Epoch 82, CIFAR-10 Batch 2: Loss: 0.5982 Validation Accuracy: 0.724200 Epoch 82, CIFAR-10 Batch 3: Loss: 0.6028 Validation Accuracy: 0.730200 Epoch 82, CIFAR-10 Batch 4: Loss: 0.5376 Validation Accuracy: 0.743800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.5399 Validation Accuracy: 0.753000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.6227 Validation Accuracy: 0.758400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.5385 Validation Accuracy: 0.762000 Epoch 83, CIFAR-10 Batch 3: Loss: 0.5551 Validation Accuracy: 0.761800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.761800 Epoch 83, CIFAR-10 Batch 5: Loss: 0.5312 Validation Accuracy: 0.764200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.6124 Validation Accuracy: 0.763400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.5325 Validation Accuracy: 0.765200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.5505 Validation Accuracy: 0.766800 Epoch 84, CIFAR-10 Batch 4: Loss: 0.5080 Validation Accuracy: 0.768000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.5306 Validation Accuracy: 0.769200 Epoch 85, CIFAR-10 Batch 1: Loss: 0.6118 Validation Accuracy: 0.769800 Epoch 85, CIFAR-10 Batch 2: Loss: 0.5318 Validation Accuracy: 0.769800 Epoch 85, CIFAR-10 Batch 3: Loss: 0.5500 Validation Accuracy: 0.770600 Epoch 85, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.770400 Epoch 85, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 86, CIFAR-10 Batch 1: Loss: 0.6117 Validation Accuracy: 0.769400 Epoch 86, CIFAR-10 Batch 2: Loss: 0.5318 Validation Accuracy: 0.769600 Epoch 86, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 86, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 86, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 87, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 87, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 87, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 87, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 88, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 88, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 88, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 88, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 88, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 89, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 89, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 89, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 90, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 90, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 91, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 91, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 91, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 91, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 92, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 92, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 92, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 92, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 93, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 93, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 93, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 93, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 94, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 94, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 94, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 94, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 94, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 95, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 95, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 95, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 95, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 96, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.770000 Epoch 96, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 96, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.770000 Epoch 96, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 96, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 97, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 97, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 97, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 97, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 98, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 98, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769000 Epoch 98, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769200 Epoch 98, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 99, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 99, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 99, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 100, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 100, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 100, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 100, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 101, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 101, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 101, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 101, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 101, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.770000 Epoch 102, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 102, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.770000 Epoch 102, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 102, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 103, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 103, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 103, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 103, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 104, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.770000 Epoch 104, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 104, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 105, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 105, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 106, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769000 Epoch 106, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 106, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769200 Epoch 106, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 107, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 107, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 107, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 108, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 108, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 108, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 108, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769200 Epoch 109, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 109, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 109, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 110, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 110, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769200 Epoch 110, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 110, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 111, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 111, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 111, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 112, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 112, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 112, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 113, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.770200 Epoch 113, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 113, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 113, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 113, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 114, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 114, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 114, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 115, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 115, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 115, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 115, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 116, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 116, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 117, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 117, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 118, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 118, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 118, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 118, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 119, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 119, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 119, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 119, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 119, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 120, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 120, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 120, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 121, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 121, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 121, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 121, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 122, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 122, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 123, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 123, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 123, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 124, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 124, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 124, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 124, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 124, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 125, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 125, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 125, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 126, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.770000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 126, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 126, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 126, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 127, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 127, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 127, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 127, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 127, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 128, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 128, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 128, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 128, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 128, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 129, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 129, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 130, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769000 Epoch 130, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 130, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 130, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 131, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 131, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 131, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 132, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 132, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 132, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 132, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 133, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 133, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 133, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 133, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 134, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 134, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 134, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 134, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 135, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 135, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 135, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 135, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 135, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 136, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 136, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 136, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 136, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 137, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 137, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 138, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 138, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 138, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 139, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 139, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 139, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 140, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 140, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 140, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 140, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 140, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 141, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 141, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 141, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 141, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 142, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 142, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769000 Epoch 142, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769000 Epoch 142, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 142, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 143, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 143, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 143, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 143, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 143, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 144, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 144, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 144, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 144, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 144, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 145, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 145, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 145, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 145, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 145, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 146, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 146, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 146, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 146, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 147, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 147, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 147, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 148, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 148, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Epoch 149, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 149, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 149, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 150, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 150, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769600 Epoch 150, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 150, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 150, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 151, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769800 Epoch 151, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 151, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 151, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 152, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 152, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 152, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 153, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769800 Epoch 153, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 153, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 153, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769200 Epoch 154, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 154, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 154, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 155, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 155, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 155, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 156, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769200 Epoch 156, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 157, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 157, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 157, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 157, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 157, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 158, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 158, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 158, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 158, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 158, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 159, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 159, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 159, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 160, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 160, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 160, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 160, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769600 Epoch 160, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769800 Epoch 161, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 161, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.770000 Epoch 162, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 162, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769600 Epoch 163, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769400 Epoch 163, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769400 Epoch 163, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 163, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769600 Epoch 164, CIFAR-10 Batch 1: Loss: 0.6116 Validation Accuracy: 0.769400 Epoch 164, CIFAR-10 Batch 2: Loss: 0.5317 Validation Accuracy: 0.769200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.5499 Validation Accuracy: 0.769600 Epoch 164, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.769800 Epoch 164, CIFAR-10 Batch 5: Loss: 0.5305 Validation Accuracy: 0.769800 Training for learning_rate=0.01000, batch_size=512 ... Epoch 1, CIFAR-10 Batch 1: Loss: 2.0144 Validation Accuracy: 0.106800 Epoch 1, CIFAR-10 Batch 2: Loss: 1.7637 Validation Accuracy: 0.108400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.4826 Validation Accuracy: 0.168600 Epoch 1, CIFAR-10 Batch 4: Loss: 1.4254 Validation Accuracy: 0.165600 Epoch 1, CIFAR-10 Batch 5: Loss: 1.2875 Validation Accuracy: 0.183400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.2607 Validation Accuracy: 0.194400 Epoch 2, CIFAR-10 Batch 2: Loss: 1.1708 Validation Accuracy: 0.214200 Epoch 2, CIFAR-10 Batch 3: Loss: 1.0156 Validation Accuracy: 0.158400 Epoch 2, CIFAR-10 Batch 4: Loss: 1.0011 Validation Accuracy: 0.313200 Epoch 2, CIFAR-10 Batch 5: Loss: 0.9194 Validation Accuracy: 0.344200 Epoch 3, CIFAR-10 Batch 1: Loss: 1.0503 Validation Accuracy: 0.305400 Epoch 3, CIFAR-10 Batch 2: Loss: 0.9319 Validation Accuracy: 0.243000 Epoch 3, CIFAR-10 Batch 3: Loss: 0.7909 Validation Accuracy: 0.219800 Epoch 3, CIFAR-10 Batch 4: Loss: 0.8256 Validation Accuracy: 0.233400 Epoch 3, CIFAR-10 Batch 5: Loss: 0.7613 Validation Accuracy: 0.421400 Epoch 4, CIFAR-10 Batch 1: Loss: 0.9146 Validation Accuracy: 0.229600 Epoch 4, CIFAR-10 Batch 2: Loss: 0.7415 Validation Accuracy: 0.380200 Epoch 4, CIFAR-10 Batch 3: Loss: 0.6980 Validation Accuracy: 0.422800 Epoch 4, CIFAR-10 Batch 4: Loss: 0.6830 Validation Accuracy: 0.273000 Epoch 4, CIFAR-10 Batch 5: Loss: 0.6740 Validation Accuracy: 0.496000 Epoch 5, CIFAR-10 Batch 1: Loss: 0.7977 Validation Accuracy: 0.379800 Epoch 5, CIFAR-10 Batch 2: Loss: 0.6421 Validation Accuracy: 0.363000 Epoch 5, CIFAR-10 Batch 3: Loss: 0.5993 Validation Accuracy: 0.438400 Epoch 5, CIFAR-10 Batch 4: Loss: 0.5913 Validation Accuracy: 0.476200 Epoch 5, CIFAR-10 Batch 5: Loss: 0.5731 Validation Accuracy: 0.489200 Epoch 6, CIFAR-10 Batch 1: Loss: 0.6830 Validation Accuracy: 0.461200 Epoch 6, CIFAR-10 Batch 2: Loss: 0.5512 Validation Accuracy: 0.487000 Epoch 6, CIFAR-10 Batch 3: Loss: 0.5323 Validation Accuracy: 0.489000 Epoch 6, CIFAR-10 Batch 4: Loss: 0.5790 Validation Accuracy: 0.327800 Epoch 6, CIFAR-10 Batch 5: Loss: 0.5287 Validation Accuracy: 0.558400 Epoch 7, CIFAR-10 Batch 1: Loss: 0.5773 Validation Accuracy: 0.343200 Epoch 7, CIFAR-10 Batch 2: Loss: 0.5019 Validation Accuracy: 0.415400 Epoch 7, CIFAR-10 Batch 3: Loss: 0.5018 Validation Accuracy: 0.648600 Epoch 7, CIFAR-10 Batch 4: Loss: 0.5272 Validation Accuracy: 0.555200 Epoch 7, CIFAR-10 Batch 5: Loss: 0.4695 Validation Accuracy: 0.608200 Epoch 8, CIFAR-10 Batch 1: Loss: 0.5623 Validation Accuracy: 0.567400 Epoch 8, CIFAR-10 Batch 2: Loss: 0.4793 Validation Accuracy: 0.593400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.4759 Validation Accuracy: 0.664200 Epoch 8, CIFAR-10 Batch 4: Loss: 0.4856 Validation Accuracy: 0.605800 Epoch 8, CIFAR-10 Batch 5: Loss: 0.4453 Validation Accuracy: 0.587000 Epoch 9, CIFAR-10 Batch 1: Loss: 0.5117 Validation Accuracy: 0.632400 Epoch 9, CIFAR-10 Batch 2: Loss: 0.4104 Validation Accuracy: 0.574600 Epoch 9, CIFAR-10 Batch 3: Loss: 0.4609 Validation Accuracy: 0.621200 Epoch 9, CIFAR-10 Batch 4: Loss: 0.4509 Validation Accuracy: 0.638600 Epoch 9, CIFAR-10 Batch 5: Loss: 0.4121 Validation Accuracy: 0.636600 Epoch 10, CIFAR-10 Batch 1: Loss: 0.4764 Validation Accuracy: 0.519200 Epoch 10, CIFAR-10 Batch 2: Loss: 0.3803 Validation Accuracy: 0.583400 Epoch 10, CIFAR-10 Batch 3: Loss: 0.4632 Validation Accuracy: 0.673000 Epoch 10, CIFAR-10 Batch 4: Loss: 0.4529 Validation Accuracy: 0.450200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.3798 Validation Accuracy: 0.723600 Epoch 11, CIFAR-10 Batch 1: Loss: 0.4254 Validation Accuracy: 0.713600 Epoch 11, CIFAR-10 Batch 2: Loss: 0.3799 Validation Accuracy: 0.664000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.4624 Validation Accuracy: 0.628400 Epoch 11, CIFAR-10 Batch 4: Loss: 0.4174 Validation Accuracy: 0.664400 Epoch 11, CIFAR-10 Batch 5: Loss: 0.3702 Validation Accuracy: 0.728000 Epoch 12, CIFAR-10 Batch 1: Loss: 0.3991 Validation Accuracy: 0.598600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.3331 Validation Accuracy: 0.662000 Epoch 12, CIFAR-10 Batch 3: Loss: 0.3816 Validation Accuracy: 0.668000 Epoch 12, CIFAR-10 Batch 4: Loss: 0.4193 Validation Accuracy: 0.703600 Epoch 12, CIFAR-10 Batch 5: Loss: 0.3487 Validation Accuracy: 0.780200 Epoch 13, CIFAR-10 Batch 1: Loss: 0.3865 Validation Accuracy: 0.606800 Epoch 13, CIFAR-10 Batch 2: Loss: 0.3494 Validation Accuracy: 0.778000 Epoch 13, CIFAR-10 Batch 3: Loss: 0.3823 Validation Accuracy: 0.674400 Epoch 13, CIFAR-10 Batch 4: Loss: 0.3675 Validation Accuracy: 0.675400 Epoch 13, CIFAR-10 Batch 5: Loss: 0.3448 Validation Accuracy: 0.777200 Epoch 14, CIFAR-10 Batch 1: Loss: 0.3439 Validation Accuracy: 0.673400 Epoch 14, CIFAR-10 Batch 2: Loss: 0.3287 Validation Accuracy: 0.778800 Epoch 14, CIFAR-10 Batch 3: Loss: 0.3727 Validation Accuracy: 0.679400 Epoch 14, CIFAR-10 Batch 4: Loss: 0.3743 Validation Accuracy: 0.724200 Epoch 14, CIFAR-10 Batch 5: Loss: 0.3397 Validation Accuracy: 0.642000 Epoch 15, CIFAR-10 Batch 1: Loss: 0.3472 Validation Accuracy: 0.619000 Epoch 15, CIFAR-10 Batch 2: Loss: 0.3298 Validation Accuracy: 0.713200 Epoch 15, CIFAR-10 Batch 3: Loss: 0.3499 Validation Accuracy: 0.751600 Epoch 15, CIFAR-10 Batch 4: Loss: 0.3433 Validation Accuracy: 0.668800 Epoch 15, CIFAR-10 Batch 5: Loss: 0.3294 Validation Accuracy: 0.671400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.3313 Validation Accuracy: 0.745000 Epoch 16, CIFAR-10 Batch 2: Loss: 0.2889 Validation Accuracy: 0.714600 Epoch 16, CIFAR-10 Batch 3: Loss: 0.3316 Validation Accuracy: 0.763000 Epoch 16, CIFAR-10 Batch 4: Loss: 0.3501 Validation Accuracy: 0.721000 Epoch 16, CIFAR-10 Batch 5: Loss: 0.3121 Validation Accuracy: 0.754200 Epoch 17, CIFAR-10 Batch 1: Loss: 0.3175 Validation Accuracy: 0.622000 Epoch 17, CIFAR-10 Batch 2: Loss: 0.3066 Validation Accuracy: 0.758200 Epoch 17, CIFAR-10 Batch 3: Loss: 0.2930 Validation Accuracy: 0.761400 Epoch 17, CIFAR-10 Batch 4: Loss: 0.3119 Validation Accuracy: 0.800800 Epoch 17, CIFAR-10 Batch 5: Loss: 0.2875 Validation Accuracy: 0.694000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.2973 Validation Accuracy: 0.762600 Epoch 18, CIFAR-10 Batch 2: Loss: 0.2824 Validation Accuracy: 0.754200 Epoch 18, CIFAR-10 Batch 3: Loss: 0.2949 Validation Accuracy: 0.775400 Epoch 18, CIFAR-10 Batch 4: Loss: 0.2952 Validation Accuracy: 0.620000 Epoch 18, CIFAR-10 Batch 5: Loss: 0.2613 Validation Accuracy: 0.748800 Epoch 19, CIFAR-10 Batch 1: Loss: 0.3129 Validation Accuracy: 0.672400 Epoch 19, CIFAR-10 Batch 2: Loss: 0.2675 Validation Accuracy: 0.739600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.3098 Validation Accuracy: 0.765600 Epoch 19, CIFAR-10 Batch 4: Loss: 0.3150 Validation Accuracy: 0.737800 Epoch 19, CIFAR-10 Batch 5: Loss: 0.2685 Validation Accuracy: 0.749600 Epoch 20, CIFAR-10 Batch 1: Loss: 0.3053 Validation Accuracy: 0.766600 Epoch 20, CIFAR-10 Batch 2: Loss: 0.2598 Validation Accuracy: 0.761600 Epoch 20, CIFAR-10 Batch 3: Loss: 0.2884 Validation Accuracy: 0.766600 Epoch 20, CIFAR-10 Batch 4: Loss: 0.2815 Validation Accuracy: 0.722400 Epoch 20, CIFAR-10 Batch 5: Loss: 0.2436 Validation Accuracy: 0.692200 Epoch 21, CIFAR-10 Batch 1: Loss: 0.2814 Validation Accuracy: 0.730400 Epoch 21, CIFAR-10 Batch 2: Loss: 0.2384 Validation Accuracy: 0.767400 Epoch 21, CIFAR-10 Batch 3: Loss: 0.2629 Validation Accuracy: 0.694400 Epoch 21, CIFAR-10 Batch 4: Loss: 0.2756 Validation Accuracy: 0.693400 Epoch 21, CIFAR-10 Batch 5: Loss: 0.2526 Validation Accuracy: 0.766000 Epoch 22, CIFAR-10 Batch 1: Loss: 0.2806 Validation Accuracy: 0.752000 Epoch 22, CIFAR-10 Batch 2: Loss: 0.2526 Validation Accuracy: 0.744000 Epoch 22, CIFAR-10 Batch 3: Loss: 0.2782 Validation Accuracy: 0.789000 Epoch 22, CIFAR-10 Batch 4: Loss: 0.2787 Validation Accuracy: 0.781600 Epoch 22, CIFAR-10 Batch 5: Loss: 0.2272 Validation Accuracy: 0.743200 Epoch 23, CIFAR-10 Batch 1: Loss: 0.2974 Validation Accuracy: 0.687200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.2427 Validation Accuracy: 0.814000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.2533 Validation Accuracy: 0.760400 Epoch 23, CIFAR-10 Batch 4: Loss: 0.2798 Validation Accuracy: 0.728000 Epoch 23, CIFAR-10 Batch 5: Loss: 0.2288 Validation Accuracy: 0.758200 Epoch 24, CIFAR-10 Batch 1: Loss: 0.2633 Validation Accuracy: 0.745200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.2329 Validation Accuracy: 0.813400 Epoch 24, CIFAR-10 Batch 3: Loss: 0.2644 Validation Accuracy: 0.810800 Epoch 24, CIFAR-10 Batch 4: Loss: 0.2562 Validation Accuracy: 0.740000 Epoch 24, CIFAR-10 Batch 5: Loss: 0.2323 Validation Accuracy: 0.735800 Epoch 25, CIFAR-10 Batch 1: Loss: 0.2440 Validation Accuracy: 0.699800 Epoch 25, CIFAR-10 Batch 2: Loss: 0.2304 Validation Accuracy: 0.819800 Epoch 25, CIFAR-10 Batch 3: Loss: 0.2345 Validation Accuracy: 0.797400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.2310 Validation Accuracy: 0.692000 Epoch 25, CIFAR-10 Batch 5: Loss: 0.2121 Validation Accuracy: 0.789400 Epoch 26, CIFAR-10 Batch 1: Loss: 0.2436 Validation Accuracy: 0.743200 Epoch 26, CIFAR-10 Batch 2: Loss: 0.2281 Validation Accuracy: 0.754600 Epoch 26, CIFAR-10 Batch 3: Loss: 0.2636 Validation Accuracy: 0.793800 Epoch 26, CIFAR-10 Batch 4: Loss: 0.2398 Validation Accuracy: 0.748000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.2197 Validation Accuracy: 0.720600 Epoch 27, CIFAR-10 Batch 1: Loss: 0.2330 Validation Accuracy: 0.787200 Epoch 27, CIFAR-10 Batch 2: Loss: 0.2239 Validation Accuracy: 0.807000 Epoch 27, CIFAR-10 Batch 3: Loss: 0.2400 Validation Accuracy: 0.736600 Epoch 27, CIFAR-10 Batch 4: Loss: 0.2417 Validation Accuracy: 0.811600 Epoch 27, CIFAR-10 Batch 5: Loss: 0.2162 Validation Accuracy: 0.776400 Epoch 28, CIFAR-10 Batch 1: Loss: 0.2396 Validation Accuracy: 0.788200 Epoch 28, CIFAR-10 Batch 2: Loss: 0.2234 Validation Accuracy: 0.789200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.2313 Validation Accuracy: 0.825200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.2302 Validation Accuracy: 0.736200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.2051 Validation Accuracy: 0.747800 Epoch 29, CIFAR-10 Batch 1: Loss: 0.2428 Validation Accuracy: 0.752400 Epoch 29, CIFAR-10 Batch 2: Loss: 0.2213 Validation Accuracy: 0.796800 Epoch 29, CIFAR-10 Batch 3: Loss: 0.2328 Validation Accuracy: 0.835000 Epoch 29, CIFAR-10 Batch 4: Loss: 0.2374 Validation Accuracy: 0.765400 Epoch 29, CIFAR-10 Batch 5: Loss: 0.2030 Validation Accuracy: 0.766400 Epoch 30, CIFAR-10 Batch 1: Loss: 0.2433 Validation Accuracy: 0.774400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.2145 Validation Accuracy: 0.693000 Epoch 30, CIFAR-10 Batch 3: Loss: 0.2205 Validation Accuracy: 0.766200 Epoch 30, CIFAR-10 Batch 4: Loss: 0.2131 Validation Accuracy: 0.808200 Epoch 30, CIFAR-10 Batch 5: Loss: 0.1884 Validation Accuracy: 0.769400 Epoch 31, CIFAR-10 Batch 1: Loss: 0.2177 Validation Accuracy: 0.805800 Epoch 31, CIFAR-10 Batch 2: Loss: 0.2001 Validation Accuracy: 0.791800 Epoch 31, CIFAR-10 Batch 3: Loss: 0.2177 Validation Accuracy: 0.833600 Epoch 31, CIFAR-10 Batch 4: Loss: 0.2067 Validation Accuracy: 0.745200 Epoch 31, CIFAR-10 Batch 5: Loss: 0.2016 Validation Accuracy: 0.744600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.2117 Validation Accuracy: 0.821400 Epoch 32, CIFAR-10 Batch 2: Loss: 0.2039 Validation Accuracy: 0.814000 Epoch 32, CIFAR-10 Batch 3: Loss: 0.2089 Validation Accuracy: 0.809000 Epoch 32, CIFAR-10 Batch 4: Loss: 0.2303 Validation Accuracy: 0.836400 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1954 Validation Accuracy: 0.671400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.2018 Validation Accuracy: 0.839200 Epoch 33, CIFAR-10 Batch 2: Loss: 0.1924 Validation Accuracy: 0.815800 Epoch 33, CIFAR-10 Batch 3: Loss: 0.2110 Validation Accuracy: 0.812600 Epoch 33, CIFAR-10 Batch 4: Loss: 0.2101 Validation Accuracy: 0.711400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1971 Validation Accuracy: 0.819000 Epoch 34, CIFAR-10 Batch 1: Loss: 0.2031 Validation Accuracy: 0.814400 Epoch 34, CIFAR-10 Batch 2: Loss: 0.2016 Validation Accuracy: 0.759600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.2137 Validation Accuracy: 0.792200 Epoch 34, CIFAR-10 Batch 4: Loss: 0.2165 Validation Accuracy: 0.755800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1932 Validation Accuracy: 0.823400 Epoch 35, CIFAR-10 Batch 1: Loss: 0.2097 Validation Accuracy: 0.818000 Epoch 35, CIFAR-10 Batch 2: Loss: 0.1927 Validation Accuracy: 0.832800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.2003 Validation Accuracy: 0.814400 Epoch 35, CIFAR-10 Batch 4: Loss: 0.2134 Validation Accuracy: 0.766200 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1930 Validation Accuracy: 0.781600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.2111 Validation Accuracy: 0.802800 Epoch 36, CIFAR-10 Batch 2: Loss: 0.1891 Validation Accuracy: 0.824800 Epoch 36, CIFAR-10 Batch 3: Loss: 0.2074 Validation Accuracy: 0.829000 Epoch 36, CIFAR-10 Batch 4: Loss: 0.1984 Validation Accuracy: 0.782000 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1819 Validation Accuracy: 0.843200 Epoch 37, CIFAR-10 Batch 1: Loss: 0.2050 Validation Accuracy: 0.837400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.1843 Validation Accuracy: 0.840600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.1958 Validation Accuracy: 0.807000 Epoch 37, CIFAR-10 Batch 4: Loss: 0.1943 Validation Accuracy: 0.782400 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1839 Validation Accuracy: 0.746000 Epoch 38, CIFAR-10 Batch 1: Loss: 0.2101 Validation Accuracy: 0.839600 Epoch 38, CIFAR-10 Batch 2: Loss: 0.1848 Validation Accuracy: 0.774800 Epoch 38, CIFAR-10 Batch 3: Loss: 0.2012 Validation Accuracy: 0.817000 Epoch 38, CIFAR-10 Batch 4: Loss: 0.2008 Validation Accuracy: 0.820000 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1875 Validation Accuracy: 0.745600 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1889 Validation Accuracy: 0.796000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.1834 Validation Accuracy: 0.784200 Epoch 39, CIFAR-10 Batch 3: Loss: 0.2025 Validation Accuracy: 0.690000 Epoch 39, CIFAR-10 Batch 4: Loss: 0.1992 Validation Accuracy: 0.762600 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1891 Validation Accuracy: 0.759600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.2011 Validation Accuracy: 0.805400 Epoch 40, CIFAR-10 Batch 2: Loss: 0.1851 Validation Accuracy: 0.785400 Epoch 40, CIFAR-10 Batch 3: Loss: 0.1994 Validation Accuracy: 0.811400 Epoch 40, CIFAR-10 Batch 4: Loss: 0.1907 Validation Accuracy: 0.824600 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1851 Validation Accuracy: 0.773600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1934 Validation Accuracy: 0.787600 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1805 Validation Accuracy: 0.767800 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1914 Validation Accuracy: 0.800200 Epoch 41, CIFAR-10 Batch 4: Loss: 0.1894 Validation Accuracy: 0.806200 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1790 Validation Accuracy: 0.782200 Epoch 42, CIFAR-10 Batch 1: Loss: 0.2007 Validation Accuracy: 0.774000 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1807 Validation Accuracy: 0.752800 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1877 Validation Accuracy: 0.723600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.1911 Validation Accuracy: 0.801400 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1763 Validation Accuracy: 0.666000 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1896 Validation Accuracy: 0.796400 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1740 Validation Accuracy: 0.791200 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1841 Validation Accuracy: 0.780800 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1877 Validation Accuracy: 0.646000 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1822 Validation Accuracy: 0.803200 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1839 Validation Accuracy: 0.816600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1815 Validation Accuracy: 0.798600 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1805 Validation Accuracy: 0.812600 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1820 Validation Accuracy: 0.776400 Epoch 44, CIFAR-10 Batch 5: Loss: 0.1829 Validation Accuracy: 0.673400 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1852 Validation Accuracy: 0.749600 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1841 Validation Accuracy: 0.796000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1769 Validation Accuracy: 0.776800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1815 Validation Accuracy: 0.797800 Epoch 45, CIFAR-10 Batch 5: Loss: 0.1708 Validation Accuracy: 0.776400 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1740 Validation Accuracy: 0.764400 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1688 Validation Accuracy: 0.825000 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1840 Validation Accuracy: 0.830000 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1829 Validation Accuracy: 0.776200 Epoch 46, CIFAR-10 Batch 5: Loss: 0.1761 Validation Accuracy: 0.737800 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1806 Validation Accuracy: 0.752000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1711 Validation Accuracy: 0.799400 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1798 Validation Accuracy: 0.812000 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1755 Validation Accuracy: 0.726000 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1790 Validation Accuracy: 0.768600 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1837 Validation Accuracy: 0.827000 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1672 Validation Accuracy: 0.810800 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1748 Validation Accuracy: 0.777000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1734 Validation Accuracy: 0.755000 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1640 Validation Accuracy: 0.740000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1694 Validation Accuracy: 0.826000 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1654 Validation Accuracy: 0.822000 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1803 Validation Accuracy: 0.793800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1700 Validation Accuracy: 0.799600 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1670 Validation Accuracy: 0.770400 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1746 Validation Accuracy: 0.814800 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1637 Validation Accuracy: 0.815600 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1665 Validation Accuracy: 0.808000 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1687 Validation Accuracy: 0.846000 Epoch 50, CIFAR-10 Batch 5: Loss: 0.1641 Validation Accuracy: 0.825200 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1673 Validation Accuracy: 0.753800 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1596 Validation Accuracy: 0.824400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1712 Validation Accuracy: 0.815600 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1660 Validation Accuracy: 0.797800 Epoch 51, CIFAR-10 Batch 5: Loss: 0.1579 Validation Accuracy: 0.697600 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1651 Validation Accuracy: 0.790400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1702 Validation Accuracy: 0.814600 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1764 Validation Accuracy: 0.832600 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1701 Validation Accuracy: 0.802800 Epoch 52, CIFAR-10 Batch 5: Loss: 0.1624 Validation Accuracy: 0.774400 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1683 Validation Accuracy: 0.804600 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1580 Validation Accuracy: 0.816600 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1716 Validation Accuracy: 0.805600 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1667 Validation Accuracy: 0.770400 Epoch 53, CIFAR-10 Batch 5: Loss: 0.1607 Validation Accuracy: 0.749000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1663 Validation Accuracy: 0.826200 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1611 Validation Accuracy: 0.838200 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1759 Validation Accuracy: 0.799000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1626 Validation Accuracy: 0.818400 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1656 Validation Accuracy: 0.831800 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1627 Validation Accuracy: 0.791200 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1549 Validation Accuracy: 0.813600 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1616 Validation Accuracy: 0.839200 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1602 Validation Accuracy: 0.787000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.1580 Validation Accuracy: 0.763800 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1661 Validation Accuracy: 0.790200 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1607 Validation Accuracy: 0.846800 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1663 Validation Accuracy: 0.794200 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1590 Validation Accuracy: 0.793600 Epoch 56, CIFAR-10 Batch 5: Loss: 0.1672 Validation Accuracy: 0.799800 Epoch 57, CIFAR-10 Batch 1: Loss: 0.1732 Validation Accuracy: 0.814400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1580 Validation Accuracy: 0.825400 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1603 Validation Accuracy: 0.836400 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1571 Validation Accuracy: 0.801200 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1643 Validation Accuracy: 0.765800 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1618 Validation Accuracy: 0.770600 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1622 Validation Accuracy: 0.825800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.1656 Validation Accuracy: 0.840600 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1595 Validation Accuracy: 0.831400 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1651 Validation Accuracy: 0.821600 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1742 Validation Accuracy: 0.733600 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1614 Validation Accuracy: 0.793000 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1643 Validation Accuracy: 0.828800 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1649 Validation Accuracy: 0.776600 Epoch 59, CIFAR-10 Batch 5: Loss: 0.1587 Validation Accuracy: 0.740600 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1669 Validation Accuracy: 0.819000 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1675 Validation Accuracy: 0.806000 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1677 Validation Accuracy: 0.779400 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1666 Validation Accuracy: 0.807800 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1610 Validation Accuracy: 0.718000 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1630 Validation Accuracy: 0.815800 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1553 Validation Accuracy: 0.836200 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1696 Validation Accuracy: 0.850200 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1566 Validation Accuracy: 0.750200 Epoch 61, CIFAR-10 Batch 5: Loss: 0.1538 Validation Accuracy: 0.811400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1579 Validation Accuracy: 0.844000 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1518 Validation Accuracy: 0.819400 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1578 Validation Accuracy: 0.784600 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1628 Validation Accuracy: 0.783600 Epoch 62, CIFAR-10 Batch 5: Loss: 0.1607 Validation Accuracy: 0.810000 Epoch 63, CIFAR-10 Batch 1: Loss: 0.1596 Validation Accuracy: 0.819800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1652 Validation Accuracy: 0.768600 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1770 Validation Accuracy: 0.827600 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1622 Validation Accuracy: 0.820200 Epoch 63, CIFAR-10 Batch 5: Loss: 0.1607 Validation Accuracy: 0.787800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1626 Validation Accuracy: 0.832000 Epoch 64, CIFAR-10 Batch 2: Loss: 0.1568 Validation Accuracy: 0.821600 Epoch 64, CIFAR-10 Batch 3: Loss: 0.1525 Validation Accuracy: 0.822600 Epoch 64, CIFAR-10 Batch 4: Loss: 0.1603 Validation Accuracy: 0.813600 Epoch 64, CIFAR-10 Batch 5: Loss: 0.1556 Validation Accuracy: 0.827600 Epoch 65, CIFAR-10 Batch 1: Loss: 0.1562 Validation Accuracy: 0.794000 Epoch 65, CIFAR-10 Batch 2: Loss: 0.1596 Validation Accuracy: 0.816400 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1536 Validation Accuracy: 0.848000 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1616 Validation Accuracy: 0.813200 Epoch 65, CIFAR-10 Batch 5: Loss: 0.1527 Validation Accuracy: 0.841600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.1583 Validation Accuracy: 0.772400 Epoch 66, CIFAR-10 Batch 2: Loss: 0.1539 Validation Accuracy: 0.812800 Epoch 66, CIFAR-10 Batch 3: Loss: 0.1551 Validation Accuracy: 0.783800 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1524 Validation Accuracy: 0.706000 Epoch 66, CIFAR-10 Batch 5: Loss: 0.1604 Validation Accuracy: 0.801000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1516 Validation Accuracy: 0.807000 Epoch 67, CIFAR-10 Batch 2: Loss: 0.1564 Validation Accuracy: 0.795200 Epoch 67, CIFAR-10 Batch 3: Loss: 0.1590 Validation Accuracy: 0.746600 Epoch 67, CIFAR-10 Batch 4: Loss: 0.1541 Validation Accuracy: 0.781200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.1505 Validation Accuracy: 0.795600 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1555 Validation Accuracy: 0.823800 Epoch 68, CIFAR-10 Batch 2: Loss: 0.1514 Validation Accuracy: 0.814400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1580 Validation Accuracy: 0.853400 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1519 Validation Accuracy: 0.811400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.1503 Validation Accuracy: 0.769800 Epoch 69, CIFAR-10 Batch 1: Loss: 0.1513 Validation Accuracy: 0.793200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.1467 Validation Accuracy: 0.813000 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1530 Validation Accuracy: 0.809800 Epoch 69, CIFAR-10 Batch 4: Loss: 0.1538 Validation Accuracy: 0.838200 Epoch 69, CIFAR-10 Batch 5: Loss: 0.1489 Validation Accuracy: 0.812000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.1548 Validation Accuracy: 0.835000 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1563 Validation Accuracy: 0.783000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1550 Validation Accuracy: 0.839400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1520 Validation Accuracy: 0.800600 Epoch 70, CIFAR-10 Batch 5: Loss: 0.1548 Validation Accuracy: 0.818200 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1536 Validation Accuracy: 0.819600 Epoch 71, CIFAR-10 Batch 2: Loss: 0.1564 Validation Accuracy: 0.793800 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1593 Validation Accuracy: 0.805600 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1568 Validation Accuracy: 0.836800 Epoch 71, CIFAR-10 Batch 5: Loss: 0.1524 Validation Accuracy: 0.780400 Epoch 72, CIFAR-10 Batch 1: Loss: 0.1543 Validation Accuracy: 0.828200 Epoch 72, CIFAR-10 Batch 2: Loss: 0.1528 Validation Accuracy: 0.839000 Epoch 72, CIFAR-10 Batch 3: Loss: 0.1527 Validation Accuracy: 0.734800 Epoch 72, CIFAR-10 Batch 4: Loss: 0.1492 Validation Accuracy: 0.825000 Epoch 72, CIFAR-10 Batch 5: Loss: 0.1461 Validation Accuracy: 0.836800 Epoch 73, CIFAR-10 Batch 1: Loss: 0.1513 Validation Accuracy: 0.810000 Epoch 73, CIFAR-10 Batch 2: Loss: 0.1461 Validation Accuracy: 0.825400 Epoch 73, CIFAR-10 Batch 3: Loss: 0.1496 Validation Accuracy: 0.820800 Epoch 73, CIFAR-10 Batch 4: Loss: 0.1493 Validation Accuracy: 0.807400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.1514 Validation Accuracy: 0.781200 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1516 Validation Accuracy: 0.832200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1580 Validation Accuracy: 0.844400 Epoch 74, CIFAR-10 Batch 3: Loss: 0.1559 Validation Accuracy: 0.848000 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1522 Validation Accuracy: 0.760800 Epoch 74, CIFAR-10 Batch 5: Loss: 0.1467 Validation Accuracy: 0.835200 Epoch 75, CIFAR-10 Batch 1: Loss: 0.1511 Validation Accuracy: 0.847000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1486 Validation Accuracy: 0.815600 Epoch 75, CIFAR-10 Batch 3: Loss: 0.1492 Validation Accuracy: 0.794000 Epoch 75, CIFAR-10 Batch 4: Loss: 0.1518 Validation Accuracy: 0.750000 Epoch 75, CIFAR-10 Batch 5: Loss: 0.1501 Validation Accuracy: 0.811400 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1527 Validation Accuracy: 0.827800 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1638 Validation Accuracy: 0.816600 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1488 Validation Accuracy: 0.808600 Epoch 76, CIFAR-10 Batch 4: Loss: 0.1471 Validation Accuracy: 0.736400 Epoch 76, CIFAR-10 Batch 5: Loss: 0.1477 Validation Accuracy: 0.826400 Epoch 77, CIFAR-10 Batch 1: Loss: 0.1460 Validation Accuracy: 0.839400 Epoch 77, CIFAR-10 Batch 2: Loss: 0.1491 Validation Accuracy: 0.846800 Epoch 77, CIFAR-10 Batch 3: Loss: 0.1482 Validation Accuracy: 0.814200 Epoch 77, CIFAR-10 Batch 4: Loss: 0.1499 Validation Accuracy: 0.768800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.1480 Validation Accuracy: 0.827400 Epoch 78, CIFAR-10 Batch 1: Loss: 0.1488 Validation Accuracy: 0.847600 Epoch 78, CIFAR-10 Batch 2: Loss: 0.1484 Validation Accuracy: 0.847800 Epoch 78, CIFAR-10 Batch 3: Loss: 0.1484 Validation Accuracy: 0.834200 Epoch 78, CIFAR-10 Batch 4: Loss: 0.1524 Validation Accuracy: 0.817600 Epoch 78, CIFAR-10 Batch 5: Loss: 0.1537 Validation Accuracy: 0.828800 Epoch 79, CIFAR-10 Batch 1: Loss: 0.1537 Validation Accuracy: 0.838800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.1494 Validation Accuracy: 0.832600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.1543 Validation Accuracy: 0.802600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.1512 Validation Accuracy: 0.752400 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1499 Validation Accuracy: 0.821800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.1512 Validation Accuracy: 0.852000 Epoch 80, CIFAR-10 Batch 2: Loss: 0.1515 Validation Accuracy: 0.860400 Epoch 80, CIFAR-10 Batch 3: Loss: 0.1481 Validation Accuracy: 0.841800 Epoch 80, CIFAR-10 Batch 4: Loss: 0.1514 Validation Accuracy: 0.813000 Epoch 80, CIFAR-10 Batch 5: Loss: 0.1504 Validation Accuracy: 0.809000 Epoch 81, CIFAR-10 Batch 1: Loss: 0.1467 Validation Accuracy: 0.773200 Epoch 81, CIFAR-10 Batch 2: Loss: 0.1491 Validation Accuracy: 0.838600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.1515 Validation Accuracy: 0.851800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.1510 Validation Accuracy: 0.814000 Epoch 81, CIFAR-10 Batch 5: Loss: 0.1486 Validation Accuracy: 0.849200 Epoch 82, CIFAR-10 Batch 1: Loss: 0.1520 Validation Accuracy: 0.869200 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1490 Validation Accuracy: 0.878400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.1468 Validation Accuracy: 0.888000 Epoch 82, CIFAR-10 Batch 4: Loss: 0.1497 Validation Accuracy: 0.888600 Epoch 82, CIFAR-10 Batch 5: Loss: 0.1396 Validation Accuracy: 0.892000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.1405 Validation Accuracy: 0.892400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.1397 Validation Accuracy: 0.893800 Epoch 83, CIFAR-10 Batch 3: Loss: 0.1414 Validation Accuracy: 0.893200 Epoch 83, CIFAR-10 Batch 4: Loss: 0.1447 Validation Accuracy: 0.892800 Epoch 83, CIFAR-10 Batch 5: Loss: 0.1387 Validation Accuracy: 0.892400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.1397 Validation Accuracy: 0.891000 Epoch 84, CIFAR-10 Batch 2: Loss: 0.1392 Validation Accuracy: 0.891400 Epoch 84, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.1440 Validation Accuracy: 0.891400 Epoch 84, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891600 Epoch 85, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 85, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 85, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 85, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 86, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 86, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 86, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 87, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 87, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 87, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 87, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 88, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 88, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 88, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 88, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 88, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 89, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 89, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 89, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 90, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 90, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 90, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891800 Epoch 91, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 91, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 92, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 92, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 93, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 93, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 94, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 94, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 94, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 94, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 95, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 95, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 96, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 96, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 96, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 96, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 97, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 97, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 97, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 97, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890400 Epoch 98, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 98, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 98, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 98, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 99, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 99, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 99, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 100, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 100, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 100, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 100, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 100, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 101, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 101, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 101, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 101, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 102, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 102, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 102, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 102, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 102, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 103, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 103, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 103, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 103, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 103, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 104, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 104, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 104, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 104, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 105, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891800 Epoch 105, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 105, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891600 Epoch 106, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 106, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 106, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890600 Epoch 107, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 107, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 107, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 108, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 108, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 108, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 108, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 109, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 109, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 109, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 110, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 110, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 110, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 110, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 111, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 111, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 111, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 112, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 112, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 112, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 112, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 113, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 113, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 113, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 113, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 114, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 114, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 114, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 115, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 115, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 116, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 116, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 116, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 116, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 117, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 117, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 117, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 118, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 118, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 118, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 118, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 119, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 119, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 119, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 120, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 120, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 120, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 121, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 121, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 121, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 122, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 122, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 122, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 122, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 123, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 123, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 123, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 124, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 124, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.890800 Epoch 124, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 124, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 125, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 125, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 125, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 125, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 126, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 126, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 126, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890600 Epoch 126, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 127, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 127, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 127, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 127, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 128, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 128, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 128, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 128, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 129, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 129, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 129, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 130, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 130, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 130, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 131, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 131, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 132, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 132, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 132, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 132, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 133, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 133, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 133, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 133, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 133, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 134, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 134, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 134, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 134, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 134, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 135, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 135, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 135, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 135, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 135, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 136, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 136, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 136, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 137, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 137, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 138, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 138, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 138, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 139, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 139, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 139, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891800 Epoch 139, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 140, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 141, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 141, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 141, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 141, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 141, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 142, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 142, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 142, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 142, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 143, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 143, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 143, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891600 Epoch 143, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 144, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 144, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891600 Epoch 144, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891600 Epoch 144, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 145, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 145, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 145, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 146, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 146, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 146, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 146, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891600 Epoch 146, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 147, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 147, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 147, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 147, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 147, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 148, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 148, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 148, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 148, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 149, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 149, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 149, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 149, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 149, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 150, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 150, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 150, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 150, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 151, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 151, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890600 Epoch 151, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 152, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 152, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891600 Epoch 152, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 152, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 152, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890600 Epoch 153, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 153, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 153, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 153, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891400 Epoch 154, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 154, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891600 Epoch 154, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891400 Epoch 155, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 155, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 155, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.890600 Epoch 155, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 156, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 156, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891400 Epoch 156, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 156, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 157, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 157, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 157, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 157, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 158, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 158, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.890800 Epoch 158, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 158, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 158, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 159, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891400 Epoch 160, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 161, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 161, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 161, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Epoch 162, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 162, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891000 Epoch 163, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.891000 Epoch 163, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891000 Epoch 163, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891000 Epoch 163, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.890800 Epoch 164, CIFAR-10 Batch 1: Loss: 0.1396 Validation Accuracy: 0.890800 Epoch 164, CIFAR-10 Batch 2: Loss: 0.1391 Validation Accuracy: 0.891000 Epoch 164, CIFAR-10 Batch 3: Loss: 0.1408 Validation Accuracy: 0.891200 Epoch 164, CIFAR-10 Batch 4: Loss: 0.1439 Validation Accuracy: 0.891200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.1386 Validation Accuracy: 0.891200 Training for learning_rate=0.00100, batch_size=512 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.8843 Validation Accuracy: 0.104800 Epoch 1, CIFAR-10 Batch 2: Loss: 1.7096 Validation Accuracy: 0.162600 Epoch 1, CIFAR-10 Batch 3: Loss: 1.4941 Validation Accuracy: 0.182600 Epoch 1, CIFAR-10 Batch 4: Loss: 1.4570 Validation Accuracy: 0.132400 Epoch 1, CIFAR-10 Batch 5: Loss: 1.3899 Validation Accuracy: 0.264800 Epoch 2, CIFAR-10 Batch 1: Loss: 1.4026 Validation Accuracy: 0.240400 Epoch 2, CIFAR-10 Batch 2: Loss: 1.3050 Validation Accuracy: 0.177400 Epoch 2, CIFAR-10 Batch 3: Loss: 1.1517 Validation Accuracy: 0.326000 Epoch 2, CIFAR-10 Batch 4: Loss: 1.1359 Validation Accuracy: 0.237600 Epoch 2, CIFAR-10 Batch 5: Loss: 1.1008 Validation Accuracy: 0.400200 Epoch 3, CIFAR-10 Batch 1: Loss: 1.1626 Validation Accuracy: 0.339200 Epoch 3, CIFAR-10 Batch 2: Loss: 1.0704 Validation Accuracy: 0.414600 Epoch 3, CIFAR-10 Batch 3: Loss: 0.9637 Validation Accuracy: 0.410000 Epoch 3, CIFAR-10 Batch 4: Loss: 0.9536 Validation Accuracy: 0.387400 Epoch 3, CIFAR-10 Batch 5: Loss: 0.9148 Validation Accuracy: 0.583600 Epoch 4, CIFAR-10 Batch 1: Loss: 1.0172 Validation Accuracy: 0.482000 Epoch 4, CIFAR-10 Batch 2: Loss: 0.8966 Validation Accuracy: 0.502400 Epoch 4, CIFAR-10 Batch 3: Loss: 0.8317 Validation Accuracy: 0.587400 Epoch 4, CIFAR-10 Batch 4: Loss: 0.8204 Validation Accuracy: 0.631800 Epoch 4, CIFAR-10 Batch 5: Loss: 0.7798 Validation Accuracy: 0.631600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.9123 Validation Accuracy: 0.598600 Epoch 5, CIFAR-10 Batch 2: Loss: 0.7861 Validation Accuracy: 0.660200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.7300 Validation Accuracy: 0.681000 Epoch 5, CIFAR-10 Batch 4: Loss: 0.7058 Validation Accuracy: 0.656800 Epoch 5, CIFAR-10 Batch 5: Loss: 0.6744 Validation Accuracy: 0.686000 Epoch 6, CIFAR-10 Batch 1: Loss: 0.7975 Validation Accuracy: 0.632200 Epoch 6, CIFAR-10 Batch 2: Loss: 0.6649 Validation Accuracy: 0.665400 Epoch 6, CIFAR-10 Batch 3: Loss: 0.6290 Validation Accuracy: 0.673200 Epoch 6, CIFAR-10 Batch 4: Loss: 0.6312 Validation Accuracy: 0.724200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.5898 Validation Accuracy: 0.677000 Epoch 7, CIFAR-10 Batch 1: Loss: 0.7229 Validation Accuracy: 0.633000 Epoch 7, CIFAR-10 Batch 2: Loss: 0.5749 Validation Accuracy: 0.712800 Epoch 7, CIFAR-10 Batch 3: Loss: 0.5456 Validation Accuracy: 0.707600 Epoch 7, CIFAR-10 Batch 4: Loss: 0.5674 Validation Accuracy: 0.741600 Epoch 7, CIFAR-10 Batch 5: Loss: 0.5389 Validation Accuracy: 0.669600 Epoch 8, CIFAR-10 Batch 1: Loss: 0.6443 Validation Accuracy: 0.681000 Epoch 8, CIFAR-10 Batch 2: Loss: 0.5060 Validation Accuracy: 0.673600 Epoch 8, CIFAR-10 Batch 3: Loss: 0.5012 Validation Accuracy: 0.763800 Epoch 8, CIFAR-10 Batch 4: Loss: 0.5076 Validation Accuracy: 0.745200 Epoch 8, CIFAR-10 Batch 5: Loss: 0.4738 Validation Accuracy: 0.694800 Epoch 9, CIFAR-10 Batch 1: Loss: 0.5679 Validation Accuracy: 0.715800 Epoch 9, CIFAR-10 Batch 2: Loss: 0.4476 Validation Accuracy: 0.730200 Epoch 9, CIFAR-10 Batch 3: Loss: 0.4488 Validation Accuracy: 0.736400 Epoch 9, CIFAR-10 Batch 4: Loss: 0.4423 Validation Accuracy: 0.771800 Epoch 9, CIFAR-10 Batch 5: Loss: 0.4143 Validation Accuracy: 0.758800 Epoch 10, CIFAR-10 Batch 1: Loss: 0.4925 Validation Accuracy: 0.696200 Epoch 10, CIFAR-10 Batch 2: Loss: 0.4039 Validation Accuracy: 0.730200 Epoch 10, CIFAR-10 Batch 3: Loss: 0.4079 Validation Accuracy: 0.754600 Epoch 10, CIFAR-10 Batch 4: Loss: 0.4022 Validation Accuracy: 0.760200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.3808 Validation Accuracy: 0.754800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.4446 Validation Accuracy: 0.747800 Epoch 11, CIFAR-10 Batch 2: Loss: 0.3460 Validation Accuracy: 0.748000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.3797 Validation Accuracy: 0.731200 Epoch 11, CIFAR-10 Batch 4: Loss: 0.3595 Validation Accuracy: 0.775800 Epoch 11, CIFAR-10 Batch 5: Loss: 0.3486 Validation Accuracy: 0.766800 Epoch 12, CIFAR-10 Batch 1: Loss: 0.3999 Validation Accuracy: 0.681400 Epoch 12, CIFAR-10 Batch 2: Loss: 0.3284 Validation Accuracy: 0.775200 Epoch 12, CIFAR-10 Batch 3: Loss: 0.3358 Validation Accuracy: 0.754800 Epoch 12, CIFAR-10 Batch 4: Loss: 0.3400 Validation Accuracy: 0.790000 Epoch 12, CIFAR-10 Batch 5: Loss: 0.3050 Validation Accuracy: 0.791200 Epoch 13, CIFAR-10 Batch 1: Loss: 0.3392 Validation Accuracy: 0.786600 Epoch 13, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.775400 Epoch 13, CIFAR-10 Batch 3: Loss: 0.3126 Validation Accuracy: 0.767000 Epoch 13, CIFAR-10 Batch 4: Loss: 0.3113 Validation Accuracy: 0.750000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.2682 Validation Accuracy: 0.786800 Epoch 14, CIFAR-10 Batch 1: Loss: 0.3140 Validation Accuracy: 0.772200 Epoch 14, CIFAR-10 Batch 2: Loss: 0.2634 Validation Accuracy: 0.807200 Epoch 14, CIFAR-10 Batch 3: Loss: 0.2689 Validation Accuracy: 0.813200 Epoch 14, CIFAR-10 Batch 4: Loss: 0.2854 Validation Accuracy: 0.792400 Epoch 14, CIFAR-10 Batch 5: Loss: 0.2401 Validation Accuracy: 0.780000 Epoch 15, CIFAR-10 Batch 1: Loss: 0.2775 Validation Accuracy: 0.785600 Epoch 15, CIFAR-10 Batch 2: Loss: 0.2422 Validation Accuracy: 0.735000 Epoch 15, CIFAR-10 Batch 3: Loss: 0.2475 Validation Accuracy: 0.790000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.2641 Validation Accuracy: 0.787200 Epoch 15, CIFAR-10 Batch 5: Loss: 0.2284 Validation Accuracy: 0.829600 Epoch 16, CIFAR-10 Batch 1: Loss: 0.2479 Validation Accuracy: 0.808600 Epoch 16, CIFAR-10 Batch 2: Loss: 0.2313 Validation Accuracy: 0.751800 Epoch 16, CIFAR-10 Batch 3: Loss: 0.2350 Validation Accuracy: 0.740200 Epoch 16, CIFAR-10 Batch 4: Loss: 0.2324 Validation Accuracy: 0.817600 Epoch 16, CIFAR-10 Batch 5: Loss: 0.2004 Validation Accuracy: 0.770400 Epoch 17, CIFAR-10 Batch 1: Loss: 0.2235 Validation Accuracy: 0.814600 Epoch 17, CIFAR-10 Batch 2: Loss: 0.2075 Validation Accuracy: 0.774200 Epoch 17, CIFAR-10 Batch 3: Loss: 0.2176 Validation Accuracy: 0.764000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.2223 Validation Accuracy: 0.822000 Epoch 17, CIFAR-10 Batch 5: Loss: 0.1925 Validation Accuracy: 0.810200 Epoch 18, CIFAR-10 Batch 1: Loss: 0.1976 Validation Accuracy: 0.811400 Epoch 18, CIFAR-10 Batch 2: Loss: 0.1933 Validation Accuracy: 0.787000 Epoch 18, CIFAR-10 Batch 3: Loss: 0.1915 Validation Accuracy: 0.779000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.2088 Validation Accuracy: 0.816800 Epoch 18, CIFAR-10 Batch 5: Loss: 0.1713 Validation Accuracy: 0.796000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.1890 Validation Accuracy: 0.790200 Epoch 19, CIFAR-10 Batch 2: Loss: 0.1937 Validation Accuracy: 0.812600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.1736 Validation Accuracy: 0.802800 Epoch 19, CIFAR-10 Batch 4: Loss: 0.1911 Validation Accuracy: 0.823600 Epoch 19, CIFAR-10 Batch 5: Loss: 0.1455 Validation Accuracy: 0.770400 Epoch 20, CIFAR-10 Batch 1: Loss: 0.1672 Validation Accuracy: 0.798400 Epoch 20, CIFAR-10 Batch 2: Loss: 0.1626 Validation Accuracy: 0.803600 Epoch 20, CIFAR-10 Batch 3: Loss: 0.1518 Validation Accuracy: 0.813200 Epoch 20, CIFAR-10 Batch 4: Loss: 0.1776 Validation Accuracy: 0.823000 Epoch 20, CIFAR-10 Batch 5: Loss: 0.1403 Validation Accuracy: 0.820800 Epoch 21, CIFAR-10 Batch 1: Loss: 0.1549 Validation Accuracy: 0.807400 Epoch 21, CIFAR-10 Batch 2: Loss: 0.1558 Validation Accuracy: 0.794000 Epoch 21, CIFAR-10 Batch 3: Loss: 0.1399 Validation Accuracy: 0.782600 Epoch 21, CIFAR-10 Batch 4: Loss: 0.1632 Validation Accuracy: 0.819400 Epoch 21, CIFAR-10 Batch 5: Loss: 0.1267 Validation Accuracy: 0.803800 Epoch 22, CIFAR-10 Batch 1: Loss: 0.1410 Validation Accuracy: 0.805400 Epoch 22, CIFAR-10 Batch 2: Loss: 0.1348 Validation Accuracy: 0.834600 Epoch 22, CIFAR-10 Batch 3: Loss: 0.1524 Validation Accuracy: 0.798400 Epoch 22, CIFAR-10 Batch 4: Loss: 0.1511 Validation Accuracy: 0.830800 Epoch 22, CIFAR-10 Batch 5: Loss: 0.1134 Validation Accuracy: 0.817400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.1289 Validation Accuracy: 0.821400 Epoch 23, CIFAR-10 Batch 2: Loss: 0.1264 Validation Accuracy: 0.816000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.1240 Validation Accuracy: 0.818600 Epoch 23, CIFAR-10 Batch 4: Loss: 0.1379 Validation Accuracy: 0.830200 Epoch 23, CIFAR-10 Batch 5: Loss: 0.1101 Validation Accuracy: 0.774600 Epoch 24, CIFAR-10 Batch 1: Loss: 0.1170 Validation Accuracy: 0.827000 Epoch 24, CIFAR-10 Batch 2: Loss: 0.1175 Validation Accuracy: 0.824000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.1134 Validation Accuracy: 0.776400 Epoch 24, CIFAR-10 Batch 4: Loss: 0.1259 Validation Accuracy: 0.825600 Epoch 24, CIFAR-10 Batch 5: Loss: 0.1069 Validation Accuracy: 0.765800 Epoch 25, CIFAR-10 Batch 1: Loss: 0.1100 Validation Accuracy: 0.830800 Epoch 25, CIFAR-10 Batch 2: Loss: 0.1061 Validation Accuracy: 0.781400 Epoch 25, CIFAR-10 Batch 3: Loss: 0.1090 Validation Accuracy: 0.797600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.1219 Validation Accuracy: 0.840200 Epoch 25, CIFAR-10 Batch 5: Loss: 0.0931 Validation Accuracy: 0.794000 Epoch 26, CIFAR-10 Batch 1: Loss: 0.1027 Validation Accuracy: 0.815400 Epoch 26, CIFAR-10 Batch 2: Loss: 0.1012 Validation Accuracy: 0.817000 Epoch 26, CIFAR-10 Batch 3: Loss: 0.1077 Validation Accuracy: 0.802400 Epoch 26, CIFAR-10 Batch 4: Loss: 0.1091 Validation Accuracy: 0.839400 Epoch 26, CIFAR-10 Batch 5: Loss: 0.0876 Validation Accuracy: 0.813800 Epoch 27, CIFAR-10 Batch 1: Loss: 0.0949 Validation Accuracy: 0.842000 Epoch 27, CIFAR-10 Batch 2: Loss: 0.0974 Validation Accuracy: 0.784600 Epoch 27, CIFAR-10 Batch 3: Loss: 0.0984 Validation Accuracy: 0.819400 Epoch 27, CIFAR-10 Batch 4: Loss: 0.1066 Validation Accuracy: 0.841000 Epoch 27, CIFAR-10 Batch 5: Loss: 0.0818 Validation Accuracy: 0.833200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.0971 Validation Accuracy: 0.822400 Epoch 28, CIFAR-10 Batch 2: Loss: 0.0873 Validation Accuracy: 0.840000 Epoch 28, CIFAR-10 Batch 3: Loss: 0.0930 Validation Accuracy: 0.794200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.1021 Validation Accuracy: 0.845600 Epoch 28, CIFAR-10 Batch 5: Loss: 0.0814 Validation Accuracy: 0.757000 Epoch 29, CIFAR-10 Batch 1: Loss: 0.0879 Validation Accuracy: 0.829800 Epoch 29, CIFAR-10 Batch 2: Loss: 0.0894 Validation Accuracy: 0.836400 Epoch 29, CIFAR-10 Batch 3: Loss: 0.0876 Validation Accuracy: 0.842400 Epoch 29, CIFAR-10 Batch 4: Loss: 0.0965 Validation Accuracy: 0.847800 Epoch 29, CIFAR-10 Batch 5: Loss: 0.0788 Validation Accuracy: 0.850000 Epoch 30, CIFAR-10 Batch 1: Loss: 0.0835 Validation Accuracy: 0.845200 Epoch 30, CIFAR-10 Batch 2: Loss: 0.0788 Validation Accuracy: 0.836400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.0802 Validation Accuracy: 0.820000 Epoch 30, CIFAR-10 Batch 4: Loss: 0.0934 Validation Accuracy: 0.856200 Epoch 30, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.827400 Epoch 31, CIFAR-10 Batch 1: Loss: 0.0846 Validation Accuracy: 0.821000 Epoch 31, CIFAR-10 Batch 2: Loss: 0.0744 Validation Accuracy: 0.832200 Epoch 31, CIFAR-10 Batch 3: Loss: 0.0799 Validation Accuracy: 0.825200 Epoch 31, CIFAR-10 Batch 4: Loss: 0.0840 Validation Accuracy: 0.844400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.0711 Validation Accuracy: 0.795800 Epoch 32, CIFAR-10 Batch 1: Loss: 0.0788 Validation Accuracy: 0.800200 Epoch 32, CIFAR-10 Batch 2: Loss: 0.0711 Validation Accuracy: 0.827400 Epoch 32, CIFAR-10 Batch 3: Loss: 0.0757 Validation Accuracy: 0.832800 Epoch 32, CIFAR-10 Batch 4: Loss: 0.0855 Validation Accuracy: 0.846600 Epoch 32, CIFAR-10 Batch 5: Loss: 0.0655 Validation Accuracy: 0.844800 Epoch 33, CIFAR-10 Batch 1: Loss: 0.0732 Validation Accuracy: 0.846400 Epoch 33, CIFAR-10 Batch 2: Loss: 0.0718 Validation Accuracy: 0.808800 Epoch 33, CIFAR-10 Batch 3: Loss: 0.0716 Validation Accuracy: 0.857000 Epoch 33, CIFAR-10 Batch 4: Loss: 0.0792 Validation Accuracy: 0.862200 Epoch 33, CIFAR-10 Batch 5: Loss: 0.0599 Validation Accuracy: 0.842200 Epoch 34, CIFAR-10 Batch 1: Loss: 0.0741 Validation Accuracy: 0.836800 Epoch 34, CIFAR-10 Batch 2: Loss: 0.0689 Validation Accuracy: 0.828600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.0664 Validation Accuracy: 0.855400 Epoch 34, CIFAR-10 Batch 4: Loss: 0.0759 Validation Accuracy: 0.862400 Epoch 34, CIFAR-10 Batch 5: Loss: 0.0613 Validation Accuracy: 0.795400 Epoch 35, CIFAR-10 Batch 1: Loss: 0.0659 Validation Accuracy: 0.852600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.0678 Validation Accuracy: 0.830200 Epoch 35, CIFAR-10 Batch 3: Loss: 0.0616 Validation Accuracy: 0.843400 Epoch 35, CIFAR-10 Batch 4: Loss: 0.0766 Validation Accuracy: 0.862000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.0606 Validation Accuracy: 0.841600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.0640 Validation Accuracy: 0.858400 Epoch 36, CIFAR-10 Batch 2: Loss: 0.0621 Validation Accuracy: 0.834200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.0656 Validation Accuracy: 0.848600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.864400 Epoch 36, CIFAR-10 Batch 5: Loss: 0.0601 Validation Accuracy: 0.836600 Epoch 37, CIFAR-10 Batch 1: Loss: 0.0643 Validation Accuracy: 0.838400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.0613 Validation Accuracy: 0.828200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.0589 Validation Accuracy: 0.841400 Epoch 37, CIFAR-10 Batch 4: Loss: 0.0723 Validation Accuracy: 0.862400 Epoch 37, CIFAR-10 Batch 5: Loss: 0.0561 Validation Accuracy: 0.858400 Epoch 38, CIFAR-10 Batch 1: Loss: 0.0625 Validation Accuracy: 0.861000 Epoch 38, CIFAR-10 Batch 2: Loss: 0.0578 Validation Accuracy: 0.822000 Epoch 38, CIFAR-10 Batch 3: Loss: 0.0606 Validation Accuracy: 0.841400 Epoch 38, CIFAR-10 Batch 4: Loss: 0.0677 Validation Accuracy: 0.853800 Epoch 38, CIFAR-10 Batch 5: Loss: 0.0559 Validation Accuracy: 0.845200 Epoch 39, CIFAR-10 Batch 1: Loss: 0.0623 Validation Accuracy: 0.857000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.0609 Validation Accuracy: 0.826800 Epoch 39, CIFAR-10 Batch 3: Loss: 0.0611 Validation Accuracy: 0.857200 Epoch 39, CIFAR-10 Batch 4: Loss: 0.0727 Validation Accuracy: 0.849000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.0553 Validation Accuracy: 0.815400 Epoch 40, CIFAR-10 Batch 1: Loss: 0.0615 Validation Accuracy: 0.833800 Epoch 40, CIFAR-10 Batch 2: Loss: 0.0571 Validation Accuracy: 0.836000 Epoch 40, CIFAR-10 Batch 3: Loss: 0.0604 Validation Accuracy: 0.838000 Epoch 40, CIFAR-10 Batch 4: Loss: 0.0683 Validation Accuracy: 0.844400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.0600 Validation Accuracy: 0.832400 Epoch 41, CIFAR-10 Batch 1: Loss: 0.0619 Validation Accuracy: 0.855400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.0569 Validation Accuracy: 0.839400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.0554 Validation Accuracy: 0.834200 Epoch 41, CIFAR-10 Batch 4: Loss: 0.0682 Validation Accuracy: 0.858400 Epoch 41, CIFAR-10 Batch 5: Loss: 0.0556 Validation Accuracy: 0.837400 Epoch 42, CIFAR-10 Batch 1: Loss: 0.0582 Validation Accuracy: 0.870800 Epoch 42, CIFAR-10 Batch 2: Loss: 0.0556 Validation Accuracy: 0.844400 Epoch 42, CIFAR-10 Batch 3: Loss: 0.0557 Validation Accuracy: 0.852800 Epoch 42, CIFAR-10 Batch 4: Loss: 0.0678 Validation Accuracy: 0.841000 Epoch 42, CIFAR-10 Batch 5: Loss: 0.0521 Validation Accuracy: 0.855200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.0586 Validation Accuracy: 0.858600 Epoch 43, CIFAR-10 Batch 2: Loss: 0.0574 Validation Accuracy: 0.856400 Epoch 43, CIFAR-10 Batch 3: Loss: 0.0549 Validation Accuracy: 0.849000 Epoch 43, CIFAR-10 Batch 4: Loss: 0.0657 Validation Accuracy: 0.847800 Epoch 43, CIFAR-10 Batch 5: Loss: 0.0535 Validation Accuracy: 0.854200 Epoch 44, CIFAR-10 Batch 1: Loss: 0.0584 Validation Accuracy: 0.854200 Epoch 44, CIFAR-10 Batch 2: Loss: 0.0548 Validation Accuracy: 0.846000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.0584 Validation Accuracy: 0.846000 Epoch 44, CIFAR-10 Batch 4: Loss: 0.0642 Validation Accuracy: 0.850600 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0572 Validation Accuracy: 0.829800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.856800 Epoch 45, CIFAR-10 Batch 2: Loss: 0.0545 Validation Accuracy: 0.816600 Epoch 45, CIFAR-10 Batch 3: Loss: 0.0525 Validation Accuracy: 0.851200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.0655 Validation Accuracy: 0.845200 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0521 Validation Accuracy: 0.826400 Epoch 46, CIFAR-10 Batch 1: Loss: 0.0543 Validation Accuracy: 0.839800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.0517 Validation Accuracy: 0.842200 Epoch 46, CIFAR-10 Batch 3: Loss: 0.0530 Validation Accuracy: 0.825800 Epoch 46, CIFAR-10 Batch 4: Loss: 0.0628 Validation Accuracy: 0.858600 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0508 Validation Accuracy: 0.856800 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0537 Validation Accuracy: 0.840200 Epoch 47, CIFAR-10 Batch 2: Loss: 0.0522 Validation Accuracy: 0.831800 Epoch 47, CIFAR-10 Batch 3: Loss: 0.0561 Validation Accuracy: 0.854000 Epoch 47, CIFAR-10 Batch 4: Loss: 0.0668 Validation Accuracy: 0.826200 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0544 Validation Accuracy: 0.827200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.0527 Validation Accuracy: 0.836800 Epoch 48, CIFAR-10 Batch 2: Loss: 0.0530 Validation Accuracy: 0.847200 Epoch 48, CIFAR-10 Batch 3: Loss: 0.0513 Validation Accuracy: 0.865000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.0644 Validation Accuracy: 0.842400 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0510 Validation Accuracy: 0.864000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0530 Validation Accuracy: 0.861200 Epoch 49, CIFAR-10 Batch 2: Loss: 0.0515 Validation Accuracy: 0.852400 Epoch 49, CIFAR-10 Batch 3: Loss: 0.0516 Validation Accuracy: 0.843200 Epoch 49, CIFAR-10 Batch 4: Loss: 0.0626 Validation Accuracy: 0.816000 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0505 Validation Accuracy: 0.834200 Epoch 50, CIFAR-10 Batch 1: Loss: 0.0508 Validation Accuracy: 0.859000 Epoch 50, CIFAR-10 Batch 2: Loss: 0.0516 Validation Accuracy: 0.822400 Epoch 50, CIFAR-10 Batch 3: Loss: 0.0523 Validation Accuracy: 0.827400 Epoch 50, CIFAR-10 Batch 4: Loss: 0.0606 Validation Accuracy: 0.845000 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0492 Validation Accuracy: 0.840400 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0512 Validation Accuracy: 0.824200 Epoch 51, CIFAR-10 Batch 2: Loss: 0.0536 Validation Accuracy: 0.854400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.0515 Validation Accuracy: 0.845800 Epoch 51, CIFAR-10 Batch 4: Loss: 0.0604 Validation Accuracy: 0.843400 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0504 Validation Accuracy: 0.837800 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0516 Validation Accuracy: 0.852600 Epoch 52, CIFAR-10 Batch 2: Loss: 0.0521 Validation Accuracy: 0.853800 Epoch 52, CIFAR-10 Batch 3: Loss: 0.0521 Validation Accuracy: 0.829000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.0572 Validation Accuracy: 0.836800 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0515 Validation Accuracy: 0.853200 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0516 Validation Accuracy: 0.849400 Epoch 53, CIFAR-10 Batch 2: Loss: 0.0527 Validation Accuracy: 0.836600 Epoch 53, CIFAR-10 Batch 3: Loss: 0.0492 Validation Accuracy: 0.861000 Epoch 53, CIFAR-10 Batch 4: Loss: 0.0623 Validation Accuracy: 0.851000 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0490 Validation Accuracy: 0.853200 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0505 Validation Accuracy: 0.840800 Epoch 54, CIFAR-10 Batch 2: Loss: 0.0514 Validation Accuracy: 0.844800 Epoch 54, CIFAR-10 Batch 3: Loss: 0.0521 Validation Accuracy: 0.854000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.0606 Validation Accuracy: 0.832400 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0501 Validation Accuracy: 0.861400 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0512 Validation Accuracy: 0.865600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.0495 Validation Accuracy: 0.840000 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0486 Validation Accuracy: 0.839400 Epoch 55, CIFAR-10 Batch 4: Loss: 0.0623 Validation Accuracy: 0.821000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0483 Validation Accuracy: 0.842800 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0497 Validation Accuracy: 0.848000 Epoch 56, CIFAR-10 Batch 2: Loss: 0.0478 Validation Accuracy: 0.847400 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0500 Validation Accuracy: 0.865200 Epoch 56, CIFAR-10 Batch 4: Loss: 0.0607 Validation Accuracy: 0.839200 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0495 Validation Accuracy: 0.833600 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0491 Validation Accuracy: 0.869800 Epoch 57, CIFAR-10 Batch 2: Loss: 0.0474 Validation Accuracy: 0.845000 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0468 Validation Accuracy: 0.840600 Epoch 57, CIFAR-10 Batch 4: Loss: 0.0603 Validation Accuracy: 0.862200 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0484 Validation Accuracy: 0.858600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0488 Validation Accuracy: 0.845000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0488 Validation Accuracy: 0.818000 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0483 Validation Accuracy: 0.862000 Epoch 58, CIFAR-10 Batch 4: Loss: 0.0581 Validation Accuracy: 0.844400 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0469 Validation Accuracy: 0.863800 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0495 Validation Accuracy: 0.837600 Epoch 59, CIFAR-10 Batch 2: Loss: 0.0503 Validation Accuracy: 0.841000 Epoch 59, CIFAR-10 Batch 3: Loss: 0.0474 Validation Accuracy: 0.853400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.0539 Validation Accuracy: 0.846000 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0472 Validation Accuracy: 0.829400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0491 Validation Accuracy: 0.845600 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0485 Validation Accuracy: 0.818400 Epoch 60, CIFAR-10 Batch 3: Loss: 0.0474 Validation Accuracy: 0.854200 Epoch 60, CIFAR-10 Batch 4: Loss: 0.0526 Validation Accuracy: 0.825600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0462 Validation Accuracy: 0.863600 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0478 Validation Accuracy: 0.864400 Epoch 61, CIFAR-10 Batch 2: Loss: 0.0472 Validation Accuracy: 0.846800 Epoch 61, CIFAR-10 Batch 3: Loss: 0.0486 Validation Accuracy: 0.865600 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0527 Validation Accuracy: 0.864800 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0457 Validation Accuracy: 0.800400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0468 Validation Accuracy: 0.852200 Epoch 62, CIFAR-10 Batch 2: Loss: 0.0474 Validation Accuracy: 0.852800 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0507 Validation Accuracy: 0.831800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.858400 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0467 Validation Accuracy: 0.857400 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0463 Validation Accuracy: 0.866600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0464 Validation Accuracy: 0.825800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0456 Validation Accuracy: 0.855600 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0519 Validation Accuracy: 0.868000 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0463 Validation Accuracy: 0.847600 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0480 Validation Accuracy: 0.836600 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0473 Validation Accuracy: 0.811200 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0467 Validation Accuracy: 0.839800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0523 Validation Accuracy: 0.867000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0463 Validation Accuracy: 0.839000 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0479 Validation Accuracy: 0.871800 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0495 Validation Accuracy: 0.864800 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0487 Validation Accuracy: 0.853000 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0531 Validation Accuracy: 0.846000 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0456 Validation Accuracy: 0.857400 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0483 Validation Accuracy: 0.867000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0464 Validation Accuracy: 0.861000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0476 Validation Accuracy: 0.839000 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0505 Validation Accuracy: 0.866400 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0464 Validation Accuracy: 0.861400 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0474 Validation Accuracy: 0.836200 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0467 Validation Accuracy: 0.848600 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0466 Validation Accuracy: 0.850600 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0503 Validation Accuracy: 0.870600 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0466 Validation Accuracy: 0.858800 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0458 Validation Accuracy: 0.863800 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0471 Validation Accuracy: 0.860400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0469 Validation Accuracy: 0.868000 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0507 Validation Accuracy: 0.850600 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0455 Validation Accuracy: 0.850600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.857800 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0460 Validation Accuracy: 0.847000 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0455 Validation Accuracy: 0.870400 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0471 Validation Accuracy: 0.836600 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0476 Validation Accuracy: 0.830600 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0477 Validation Accuracy: 0.825400 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0465 Validation Accuracy: 0.865800 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0475 Validation Accuracy: 0.835400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0477 Validation Accuracy: 0.850400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0458 Validation Accuracy: 0.835600 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0481 Validation Accuracy: 0.853800 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0458 Validation Accuracy: 0.852000 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.856200 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0472 Validation Accuracy: 0.846000 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0459 Validation Accuracy: 0.831400 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0461 Validation Accuracy: 0.836400 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0462 Validation Accuracy: 0.871800 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0463 Validation Accuracy: 0.872400 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0455 Validation Accuracy: 0.860400 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0463 Validation Accuracy: 0.842400 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0455 Validation Accuracy: 0.865000 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0471 Validation Accuracy: 0.877200 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0452 Validation Accuracy: 0.863200 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0478 Validation Accuracy: 0.830400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0446 Validation Accuracy: 0.833400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0450 Validation Accuracy: 0.834200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0455 Validation Accuracy: 0.863000 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0453 Validation Accuracy: 0.854600 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0481 Validation Accuracy: 0.845000 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0449 Validation Accuracy: 0.852200 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0455 Validation Accuracy: 0.857000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0454 Validation Accuracy: 0.851600 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0451 Validation Accuracy: 0.872800 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0458 Validation Accuracy: 0.826800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0440 Validation Accuracy: 0.848200 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0464 Validation Accuracy: 0.838400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0451 Validation Accuracy: 0.841200 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0457 Validation Accuracy: 0.872000 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0467 Validation Accuracy: 0.878200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0447 Validation Accuracy: 0.854800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0454 Validation Accuracy: 0.862000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.867600 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0449 Validation Accuracy: 0.853000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0442 Validation Accuracy: 0.857600 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0451 Validation Accuracy: 0.838800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0445 Validation Accuracy: 0.834600 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0456 Validation Accuracy: 0.803400 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0445 Validation Accuracy: 0.848400 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0464 Validation Accuracy: 0.873800 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0449 Validation Accuracy: 0.840600 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0453 Validation Accuracy: 0.856800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0468 Validation Accuracy: 0.842800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0467 Validation Accuracy: 0.823000 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0455 Validation Accuracy: 0.860200 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0443 Validation Accuracy: 0.824400 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0455 Validation Accuracy: 0.867600 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0455 Validation Accuracy: 0.845800 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0465 Validation Accuracy: 0.862600 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0456 Validation Accuracy: 0.857000 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0454 Validation Accuracy: 0.837800 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0450 Validation Accuracy: 0.850200 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0459 Validation Accuracy: 0.865400 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0452 Validation Accuracy: 0.838800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0453 Validation Accuracy: 0.867000 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0451 Validation Accuracy: 0.848200 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0452 Validation Accuracy: 0.866200 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0465 Validation Accuracy: 0.884800 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0443 Validation Accuracy: 0.884600 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0439 Validation Accuracy: 0.889600 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0438 Validation Accuracy: 0.895200 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0441 Validation Accuracy: 0.894200 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0446 Validation Accuracy: 0.893600 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0440 Validation Accuracy: 0.894600 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.894400 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.894600 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.894000 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.894200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0440 Validation Accuracy: 0.894200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.894000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893800 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.894000 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893800 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.892800 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892800 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892800 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893600 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893600 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.892800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892800 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893600 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.892800 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.892800 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.892800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893400 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892800 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.892800 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.892800 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.892800 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893600 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.892800 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893400 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893000 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.892800 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893200 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893200 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.893000 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0445 Validation Accuracy: 0.893000 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0439 Validation Accuracy: 0.893200 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0437 Validation Accuracy: 0.893200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.893600 Training for learning_rate=0.00010, batch_size=512 ... Epoch 1, CIFAR-10 Batch 1: Loss: 2.1076 Validation Accuracy: 0.124000 Epoch 1, CIFAR-10 Batch 2: Loss: 1.9875 Validation Accuracy: 0.149000 Epoch 1, CIFAR-10 Batch 3: Loss: 1.9203 Validation Accuracy: 0.141200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.8875 Validation Accuracy: 0.139200 Epoch 1, CIFAR-10 Batch 5: Loss: 1.8278 Validation Accuracy: 0.129400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.8339 Validation Accuracy: 0.130200 Epoch 2, CIFAR-10 Batch 2: Loss: 1.7507 Validation Accuracy: 0.123600 Epoch 2, CIFAR-10 Batch 3: Loss: 1.6683 Validation Accuracy: 0.125800 Epoch 2, CIFAR-10 Batch 4: Loss: 1.6824 Validation Accuracy: 0.139200 Epoch 2, CIFAR-10 Batch 5: Loss: 1.6228 Validation Accuracy: 0.161200 Epoch 3, CIFAR-10 Batch 1: Loss: 1.6989 Validation Accuracy: 0.127200 Epoch 3, CIFAR-10 Batch 2: Loss: 1.6346 Validation Accuracy: 0.157800 Epoch 3, CIFAR-10 Batch 3: Loss: 1.5484 Validation Accuracy: 0.172400 Epoch 3, CIFAR-10 Batch 4: Loss: 1.5568 Validation Accuracy: 0.211400 Epoch 3, CIFAR-10 Batch 5: Loss: 1.5132 Validation Accuracy: 0.228200 Epoch 4, CIFAR-10 Batch 1: Loss: 1.6023 Validation Accuracy: 0.213200 Epoch 4, CIFAR-10 Batch 2: Loss: 1.5376 Validation Accuracy: 0.251200 Epoch 4, CIFAR-10 Batch 3: Loss: 1.4476 Validation Accuracy: 0.267200 Epoch 4, CIFAR-10 Batch 4: Loss: 1.4558 Validation Accuracy: 0.320200 Epoch 4, CIFAR-10 Batch 5: Loss: 1.4370 Validation Accuracy: 0.328400 Epoch 5, CIFAR-10 Batch 1: Loss: 1.5311 Validation Accuracy: 0.346400 Epoch 5, CIFAR-10 Batch 2: Loss: 1.4576 Validation Accuracy: 0.359000 Epoch 5, CIFAR-10 Batch 3: Loss: 1.3623 Validation Accuracy: 0.368800 Epoch 5, CIFAR-10 Batch 4: Loss: 1.3819 Validation Accuracy: 0.403400 Epoch 5, CIFAR-10 Batch 5: Loss: 1.3701 Validation Accuracy: 0.414000 Epoch 6, CIFAR-10 Batch 1: Loss: 1.4705 Validation Accuracy: 0.441200 Epoch 6, CIFAR-10 Batch 2: Loss: 1.3921 Validation Accuracy: 0.441600 Epoch 6, CIFAR-10 Batch 3: Loss: 1.3116 Validation Accuracy: 0.437000 Epoch 6, CIFAR-10 Batch 4: Loss: 1.3103 Validation Accuracy: 0.458800 Epoch 6, CIFAR-10 Batch 5: Loss: 1.3192 Validation Accuracy: 0.477000 Epoch 7, CIFAR-10 Batch 1: Loss: 1.4206 Validation Accuracy: 0.520000 Epoch 7, CIFAR-10 Batch 2: Loss: 1.3355 Validation Accuracy: 0.488600 Epoch 7, CIFAR-10 Batch 3: Loss: 1.2576 Validation Accuracy: 0.505200 Epoch 7, CIFAR-10 Batch 4: Loss: 1.2677 Validation Accuracy: 0.530800 Epoch 7, CIFAR-10 Batch 5: Loss: 1.2680 Validation Accuracy: 0.530800 Epoch 8, CIFAR-10 Batch 1: Loss: 1.3765 Validation Accuracy: 0.573600 Epoch 8, CIFAR-10 Batch 2: Loss: 1.2869 Validation Accuracy: 0.513000 Epoch 8, CIFAR-10 Batch 3: Loss: 1.2218 Validation Accuracy: 0.551200 Epoch 8, CIFAR-10 Batch 4: Loss: 1.2252 Validation Accuracy: 0.552200 Epoch 8, CIFAR-10 Batch 5: Loss: 1.2290 Validation Accuracy: 0.565600 Epoch 9, CIFAR-10 Batch 1: Loss: 1.3399 Validation Accuracy: 0.598800 Epoch 9, CIFAR-10 Batch 2: Loss: 1.2447 Validation Accuracy: 0.565200 Epoch 9, CIFAR-10 Batch 3: Loss: 1.1816 Validation Accuracy: 0.598600 Epoch 9, CIFAR-10 Batch 4: Loss: 1.1841 Validation Accuracy: 0.591000 Epoch 9, CIFAR-10 Batch 5: Loss: 1.1901 Validation Accuracy: 0.554200 Epoch 10, CIFAR-10 Batch 1: Loss: 1.2994 Validation Accuracy: 0.593800 Epoch 10, CIFAR-10 Batch 2: Loss: 1.2043 Validation Accuracy: 0.545000 Epoch 10, CIFAR-10 Batch 3: Loss: 1.1503 Validation Accuracy: 0.569800 Epoch 10, CIFAR-10 Batch 4: Loss: 1.1474 Validation Accuracy: 0.598800 Epoch 10, CIFAR-10 Batch 5: Loss: 1.1495 Validation Accuracy: 0.554200 Epoch 11, CIFAR-10 Batch 1: Loss: 1.2640 Validation Accuracy: 0.602400 Epoch 11, CIFAR-10 Batch 2: Loss: 1.1713 Validation Accuracy: 0.557400 Epoch 11, CIFAR-10 Batch 3: Loss: 1.1173 Validation Accuracy: 0.593800 Epoch 11, CIFAR-10 Batch 4: Loss: 1.1114 Validation Accuracy: 0.600400 Epoch 11, CIFAR-10 Batch 5: Loss: 1.1222 Validation Accuracy: 0.566400 Epoch 12, CIFAR-10 Batch 1: Loss: 1.2311 Validation Accuracy: 0.597000 Epoch 12, CIFAR-10 Batch 2: Loss: 1.1346 Validation Accuracy: 0.568400 Epoch 12, CIFAR-10 Batch 3: Loss: 1.0877 Validation Accuracy: 0.610800 Epoch 12, CIFAR-10 Batch 4: Loss: 1.0857 Validation Accuracy: 0.609400 Epoch 12, CIFAR-10 Batch 5: Loss: 1.0913 Validation Accuracy: 0.579200 Epoch 13, CIFAR-10 Batch 1: Loss: 1.1920 Validation Accuracy: 0.614400 Epoch 13, CIFAR-10 Batch 2: Loss: 1.1088 Validation Accuracy: 0.562000 Epoch 13, CIFAR-10 Batch 3: Loss: 1.0615 Validation Accuracy: 0.613800 Epoch 13, CIFAR-10 Batch 4: Loss: 1.0522 Validation Accuracy: 0.614800 Epoch 13, CIFAR-10 Batch 5: Loss: 1.0579 Validation Accuracy: 0.583400 Epoch 14, CIFAR-10 Batch 1: Loss: 1.1680 Validation Accuracy: 0.612200 Epoch 14, CIFAR-10 Batch 2: Loss: 1.0835 Validation Accuracy: 0.584400 Epoch 14, CIFAR-10 Batch 3: Loss: 1.0292 Validation Accuracy: 0.610800 Epoch 14, CIFAR-10 Batch 4: Loss: 1.0226 Validation Accuracy: 0.610000 Epoch 14, CIFAR-10 Batch 5: Loss: 1.0304 Validation Accuracy: 0.598200 Epoch 15, CIFAR-10 Batch 1: Loss: 1.1428 Validation Accuracy: 0.632800 Epoch 15, CIFAR-10 Batch 2: Loss: 1.0529 Validation Accuracy: 0.578200 Epoch 15, CIFAR-10 Batch 3: Loss: 1.0059 Validation Accuracy: 0.602000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.9942 Validation Accuracy: 0.606600 Epoch 15, CIFAR-10 Batch 5: Loss: 1.0036 Validation Accuracy: 0.570600 Epoch 16, CIFAR-10 Batch 1: Loss: 1.1095 Validation Accuracy: 0.621600 Epoch 16, CIFAR-10 Batch 2: Loss: 1.0212 Validation Accuracy: 0.582800 Epoch 16, CIFAR-10 Batch 3: Loss: 0.9813 Validation Accuracy: 0.617400 Epoch 16, CIFAR-10 Batch 4: Loss: 0.9618 Validation Accuracy: 0.616200 Epoch 16, CIFAR-10 Batch 5: Loss: 0.9848 Validation Accuracy: 0.580000 Epoch 17, CIFAR-10 Batch 1: Loss: 1.0865 Validation Accuracy: 0.633000 Epoch 17, CIFAR-10 Batch 2: Loss: 0.9977 Validation Accuracy: 0.594800 Epoch 17, CIFAR-10 Batch 3: Loss: 0.9698 Validation Accuracy: 0.624400 Epoch 17, CIFAR-10 Batch 4: Loss: 0.9336 Validation Accuracy: 0.627400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.9604 Validation Accuracy: 0.586800 Epoch 18, CIFAR-10 Batch 1: Loss: 1.0660 Validation Accuracy: 0.633800 Epoch 18, CIFAR-10 Batch 2: Loss: 0.9797 Validation Accuracy: 0.594600 Epoch 18, CIFAR-10 Batch 3: Loss: 0.9394 Validation Accuracy: 0.613800 Epoch 18, CIFAR-10 Batch 4: Loss: 0.9155 Validation Accuracy: 0.621200 Epoch 18, CIFAR-10 Batch 5: Loss: 0.9388 Validation Accuracy: 0.607000 Epoch 19, CIFAR-10 Batch 1: Loss: 1.0428 Validation Accuracy: 0.644000 Epoch 19, CIFAR-10 Batch 2: Loss: 0.9559 Validation Accuracy: 0.587200 Epoch 19, CIFAR-10 Batch 3: Loss: 0.9210 Validation Accuracy: 0.613400 Epoch 19, CIFAR-10 Batch 4: Loss: 0.8967 Validation Accuracy: 0.617000 Epoch 19, CIFAR-10 Batch 5: Loss: 0.9107 Validation Accuracy: 0.592000 Epoch 20, CIFAR-10 Batch 1: Loss: 1.0216 Validation Accuracy: 0.646400 Epoch 20, CIFAR-10 Batch 2: Loss: 0.9348 Validation Accuracy: 0.601800 Epoch 20, CIFAR-10 Batch 3: Loss: 0.9020 Validation Accuracy: 0.618400 Epoch 20, CIFAR-10 Batch 4: Loss: 0.8699 Validation Accuracy: 0.628200 Epoch 20, CIFAR-10 Batch 5: Loss: 0.8826 Validation Accuracy: 0.598600 Epoch 21, CIFAR-10 Batch 1: Loss: 1.0021 Validation Accuracy: 0.646600 Epoch 21, CIFAR-10 Batch 2: Loss: 0.9139 Validation Accuracy: 0.623200 Epoch 21, CIFAR-10 Batch 3: Loss: 0.8795 Validation Accuracy: 0.634200 Epoch 21, CIFAR-10 Batch 4: Loss: 0.8512 Validation Accuracy: 0.629400 Epoch 21, CIFAR-10 Batch 5: Loss: 0.8687 Validation Accuracy: 0.631800 Epoch 22, CIFAR-10 Batch 1: Loss: 0.9824 Validation Accuracy: 0.667600 Epoch 22, CIFAR-10 Batch 2: Loss: 0.9016 Validation Accuracy: 0.639000 Epoch 22, CIFAR-10 Batch 3: Loss: 0.8683 Validation Accuracy: 0.616200 Epoch 22, CIFAR-10 Batch 4: Loss: 0.8362 Validation Accuracy: 0.640000 Epoch 22, CIFAR-10 Batch 5: Loss: 0.8507 Validation Accuracy: 0.638400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.9668 Validation Accuracy: 0.680200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.8707 Validation Accuracy: 0.648400 Epoch 23, CIFAR-10 Batch 3: Loss: 0.8471 Validation Accuracy: 0.649600 Epoch 23, CIFAR-10 Batch 4: Loss: 0.8041 Validation Accuracy: 0.644400 Epoch 23, CIFAR-10 Batch 5: Loss: 0.8257 Validation Accuracy: 0.636800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.9557 Validation Accuracy: 0.659600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.8558 Validation Accuracy: 0.633000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.8275 Validation Accuracy: 0.633000 Epoch 24, CIFAR-10 Batch 4: Loss: 0.7907 Validation Accuracy: 0.659200 Epoch 24, CIFAR-10 Batch 5: Loss: 0.8125 Validation Accuracy: 0.644400 Epoch 25, CIFAR-10 Batch 1: Loss: 0.9430 Validation Accuracy: 0.673400 Epoch 25, CIFAR-10 Batch 2: Loss: 0.8341 Validation Accuracy: 0.643600 Epoch 25, CIFAR-10 Batch 3: Loss: 0.8002 Validation Accuracy: 0.651800 Epoch 25, CIFAR-10 Batch 4: Loss: 0.7675 Validation Accuracy: 0.678400 Epoch 25, CIFAR-10 Batch 5: Loss: 0.7921 Validation Accuracy: 0.642800 Epoch 26, CIFAR-10 Batch 1: Loss: 0.9224 Validation Accuracy: 0.686800 Epoch 26, CIFAR-10 Batch 2: Loss: 0.8188 Validation Accuracy: 0.644200 Epoch 26, CIFAR-10 Batch 3: Loss: 0.7866 Validation Accuracy: 0.642600 Epoch 26, CIFAR-10 Batch 4: Loss: 0.7523 Validation Accuracy: 0.662600 Epoch 26, CIFAR-10 Batch 5: Loss: 0.7756 Validation Accuracy: 0.639200 Epoch 27, CIFAR-10 Batch 1: Loss: 0.9022 Validation Accuracy: 0.668600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.8043 Validation Accuracy: 0.644400 Epoch 27, CIFAR-10 Batch 3: Loss: 0.7712 Validation Accuracy: 0.644800 Epoch 27, CIFAR-10 Batch 4: Loss: 0.7382 Validation Accuracy: 0.669600 Epoch 27, CIFAR-10 Batch 5: Loss: 0.7552 Validation Accuracy: 0.642200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.8891 Validation Accuracy: 0.695400 Epoch 28, CIFAR-10 Batch 2: Loss: 0.7878 Validation Accuracy: 0.657400 Epoch 28, CIFAR-10 Batch 3: Loss: 0.7576 Validation Accuracy: 0.652000 Epoch 28, CIFAR-10 Batch 4: Loss: 0.7223 Validation Accuracy: 0.666600 Epoch 28, CIFAR-10 Batch 5: Loss: 0.7374 Validation Accuracy: 0.653800 Epoch 29, CIFAR-10 Batch 1: Loss: 0.8754 Validation Accuracy: 0.699000 Epoch 29, CIFAR-10 Batch 2: Loss: 0.7589 Validation Accuracy: 0.658600 Epoch 29, CIFAR-10 Batch 3: Loss: 0.7340 Validation Accuracy: 0.666600 Epoch 29, CIFAR-10 Batch 4: Loss: 0.7064 Validation Accuracy: 0.678600 Epoch 29, CIFAR-10 Batch 5: Loss: 0.7243 Validation Accuracy: 0.674400 Epoch 30, CIFAR-10 Batch 1: Loss: 0.8549 Validation Accuracy: 0.700000 Epoch 30, CIFAR-10 Batch 2: Loss: 0.7475 Validation Accuracy: 0.676400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.7185 Validation Accuracy: 0.663200 Epoch 30, CIFAR-10 Batch 4: Loss: 0.6941 Validation Accuracy: 0.682000 Epoch 30, CIFAR-10 Batch 5: Loss: 0.7154 Validation Accuracy: 0.646600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.8417 Validation Accuracy: 0.703600 Epoch 31, CIFAR-10 Batch 2: Loss: 0.7342 Validation Accuracy: 0.661000 Epoch 31, CIFAR-10 Batch 3: Loss: 0.7112 Validation Accuracy: 0.667200 Epoch 31, CIFAR-10 Batch 4: Loss: 0.6821 Validation Accuracy: 0.681400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.7019 Validation Accuracy: 0.662400 Epoch 32, CIFAR-10 Batch 1: Loss: 0.8265 Validation Accuracy: 0.724600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.7133 Validation Accuracy: 0.685400 Epoch 32, CIFAR-10 Batch 3: Loss: 0.6918 Validation Accuracy: 0.695000 Epoch 32, CIFAR-10 Batch 4: Loss: 0.6686 Validation Accuracy: 0.702600 Epoch 32, CIFAR-10 Batch 5: Loss: 0.6892 Validation Accuracy: 0.668600 Epoch 33, CIFAR-10 Batch 1: Loss: 0.8116 Validation Accuracy: 0.715000 Epoch 33, CIFAR-10 Batch 2: Loss: 0.6982 Validation Accuracy: 0.692200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.6810 Validation Accuracy: 0.694800 Epoch 33, CIFAR-10 Batch 4: Loss: 0.6475 Validation Accuracy: 0.698800 Epoch 33, CIFAR-10 Batch 5: Loss: 0.6717 Validation Accuracy: 0.685800 Epoch 34, CIFAR-10 Batch 1: Loss: 0.7899 Validation Accuracy: 0.731000 Epoch 34, CIFAR-10 Batch 2: Loss: 0.6843 Validation Accuracy: 0.706400 Epoch 34, CIFAR-10 Batch 3: Loss: 0.6673 Validation Accuracy: 0.694400 Epoch 34, CIFAR-10 Batch 4: Loss: 0.6406 Validation Accuracy: 0.691400 Epoch 34, CIFAR-10 Batch 5: Loss: 0.6612 Validation Accuracy: 0.631800 Epoch 35, CIFAR-10 Batch 1: Loss: 0.7880 Validation Accuracy: 0.710200 Epoch 35, CIFAR-10 Batch 2: Loss: 0.6705 Validation Accuracy: 0.702800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.6485 Validation Accuracy: 0.691600 Epoch 35, CIFAR-10 Batch 4: Loss: 0.6191 Validation Accuracy: 0.689600 Epoch 35, CIFAR-10 Batch 5: Loss: 0.6411 Validation Accuracy: 0.678800 Epoch 36, CIFAR-10 Batch 1: Loss: 0.7709 Validation Accuracy: 0.720600 Epoch 36, CIFAR-10 Batch 2: Loss: 0.6583 Validation Accuracy: 0.703800 Epoch 36, CIFAR-10 Batch 3: Loss: 0.6310 Validation Accuracy: 0.705400 Epoch 36, CIFAR-10 Batch 4: Loss: 0.6070 Validation Accuracy: 0.715600 Epoch 36, CIFAR-10 Batch 5: Loss: 0.6269 Validation Accuracy: 0.669600 Epoch 37, CIFAR-10 Batch 1: Loss: 0.7617 Validation Accuracy: 0.731600 Epoch 37, CIFAR-10 Batch 2: Loss: 0.6492 Validation Accuracy: 0.703800 Epoch 37, CIFAR-10 Batch 3: Loss: 0.6280 Validation Accuracy: 0.681200 Epoch 37, CIFAR-10 Batch 4: Loss: 0.5952 Validation Accuracy: 0.693200 Epoch 37, CIFAR-10 Batch 5: Loss: 0.6135 Validation Accuracy: 0.678600 Epoch 38, CIFAR-10 Batch 1: Loss: 0.7432 Validation Accuracy: 0.731800 Epoch 38, CIFAR-10 Batch 2: Loss: 0.6336 Validation Accuracy: 0.698400 Epoch 38, CIFAR-10 Batch 3: Loss: 0.6072 Validation Accuracy: 0.675400 Epoch 38, CIFAR-10 Batch 4: Loss: 0.5882 Validation Accuracy: 0.693600 Epoch 38, CIFAR-10 Batch 5: Loss: 0.6046 Validation Accuracy: 0.677600 Epoch 39, CIFAR-10 Batch 1: Loss: 0.7323 Validation Accuracy: 0.724400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.6238 Validation Accuracy: 0.703800 Epoch 39, CIFAR-10 Batch 3: Loss: 0.5946 Validation Accuracy: 0.682400 Epoch 39, CIFAR-10 Batch 4: Loss: 0.5753 Validation Accuracy: 0.705000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.5870 Validation Accuracy: 0.690600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.7233 Validation Accuracy: 0.736000 Epoch 40, CIFAR-10 Batch 2: Loss: 0.6038 Validation Accuracy: 0.714000 Epoch 40, CIFAR-10 Batch 3: Loss: 0.5851 Validation Accuracy: 0.709400 Epoch 40, CIFAR-10 Batch 4: Loss: 0.5625 Validation Accuracy: 0.710600 Epoch 40, CIFAR-10 Batch 5: Loss: 0.5774 Validation Accuracy: 0.713400 Epoch 41, CIFAR-10 Batch 1: Loss: 0.7134 Validation Accuracy: 0.746400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.5876 Validation Accuracy: 0.715400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.5772 Validation Accuracy: 0.708800 Epoch 41, CIFAR-10 Batch 4: Loss: 0.5507 Validation Accuracy: 0.718000 Epoch 41, CIFAR-10 Batch 5: Loss: 0.5603 Validation Accuracy: 0.704200 Epoch 42, CIFAR-10 Batch 1: Loss: 0.6934 Validation Accuracy: 0.743200 Epoch 42, CIFAR-10 Batch 2: Loss: 0.5805 Validation Accuracy: 0.709200 Epoch 42, CIFAR-10 Batch 3: Loss: 0.5705 Validation Accuracy: 0.713800 Epoch 42, CIFAR-10 Batch 4: Loss: 0.5395 Validation Accuracy: 0.723400 Epoch 42, CIFAR-10 Batch 5: Loss: 0.5455 Validation Accuracy: 0.705200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.6828 Validation Accuracy: 0.745400 Epoch 43, CIFAR-10 Batch 2: Loss: 0.5703 Validation Accuracy: 0.716800 Epoch 43, CIFAR-10 Batch 3: Loss: 0.5517 Validation Accuracy: 0.731600 Epoch 43, CIFAR-10 Batch 4: Loss: 0.5286 Validation Accuracy: 0.724600 Epoch 43, CIFAR-10 Batch 5: Loss: 0.5386 Validation Accuracy: 0.688600 Epoch 44, CIFAR-10 Batch 1: Loss: 0.6751 Validation Accuracy: 0.733400 Epoch 44, CIFAR-10 Batch 2: Loss: 0.5563 Validation Accuracy: 0.725000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.5401 Validation Accuracy: 0.706400 Epoch 44, CIFAR-10 Batch 4: Loss: 0.5175 Validation Accuracy: 0.730000 Epoch 44, CIFAR-10 Batch 5: Loss: 0.5335 Validation Accuracy: 0.727400 Epoch 45, CIFAR-10 Batch 1: Loss: 0.6596 Validation Accuracy: 0.746000 Epoch 45, CIFAR-10 Batch 2: Loss: 0.5449 Validation Accuracy: 0.699600 Epoch 45, CIFAR-10 Batch 3: Loss: 0.5335 Validation Accuracy: 0.714000 Epoch 45, CIFAR-10 Batch 4: Loss: 0.5087 Validation Accuracy: 0.707600 Epoch 45, CIFAR-10 Batch 5: Loss: 0.5216 Validation Accuracy: 0.703600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.6517 Validation Accuracy: 0.744400 Epoch 46, CIFAR-10 Batch 2: Loss: 0.5408 Validation Accuracy: 0.722200 Epoch 46, CIFAR-10 Batch 3: Loss: 0.5270 Validation Accuracy: 0.715000 Epoch 46, CIFAR-10 Batch 4: Loss: 0.5055 Validation Accuracy: 0.717400 Epoch 46, CIFAR-10 Batch 5: Loss: 0.5051 Validation Accuracy: 0.699400 Epoch 47, CIFAR-10 Batch 1: Loss: 0.6432 Validation Accuracy: 0.746400 Epoch 47, CIFAR-10 Batch 2: Loss: 0.5247 Validation Accuracy: 0.721400 Epoch 47, CIFAR-10 Batch 3: Loss: 0.5124 Validation Accuracy: 0.733200 Epoch 47, CIFAR-10 Batch 4: Loss: 0.4944 Validation Accuracy: 0.734000 Epoch 47, CIFAR-10 Batch 5: Loss: 0.4869 Validation Accuracy: 0.715600 Epoch 48, CIFAR-10 Batch 1: Loss: 0.6264 Validation Accuracy: 0.770000 Epoch 48, CIFAR-10 Batch 2: Loss: 0.5217 Validation Accuracy: 0.734800 Epoch 48, CIFAR-10 Batch 3: Loss: 0.5046 Validation Accuracy: 0.731400 Epoch 48, CIFAR-10 Batch 4: Loss: 0.4837 Validation Accuracy: 0.732000 Epoch 48, CIFAR-10 Batch 5: Loss: 0.4871 Validation Accuracy: 0.721000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.6182 Validation Accuracy: 0.758800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.5096 Validation Accuracy: 0.716800 Epoch 49, CIFAR-10 Batch 3: Loss: 0.4941 Validation Accuracy: 0.741800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.4749 Validation Accuracy: 0.738400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.4672 Validation Accuracy: 0.738400 Epoch 50, CIFAR-10 Batch 1: Loss: 0.6069 Validation Accuracy: 0.769000 Epoch 50, CIFAR-10 Batch 2: Loss: 0.4985 Validation Accuracy: 0.731600 Epoch 50, CIFAR-10 Batch 3: Loss: 0.4883 Validation Accuracy: 0.728000 Epoch 50, CIFAR-10 Batch 4: Loss: 0.4696 Validation Accuracy: 0.729600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.4613 Validation Accuracy: 0.733800 Epoch 51, CIFAR-10 Batch 1: Loss: 0.5931 Validation Accuracy: 0.757400 Epoch 51, CIFAR-10 Batch 2: Loss: 0.4867 Validation Accuracy: 0.755000 Epoch 51, CIFAR-10 Batch 3: Loss: 0.4779 Validation Accuracy: 0.735000 Epoch 51, CIFAR-10 Batch 4: Loss: 0.4536 Validation Accuracy: 0.749800 Epoch 51, CIFAR-10 Batch 5: Loss: 0.4517 Validation Accuracy: 0.727600 Epoch 52, CIFAR-10 Batch 1: Loss: 0.5783 Validation Accuracy: 0.759600 Epoch 52, CIFAR-10 Batch 2: Loss: 0.4841 Validation Accuracy: 0.734400 Epoch 52, CIFAR-10 Batch 3: Loss: 0.4644 Validation Accuracy: 0.738800 Epoch 52, CIFAR-10 Batch 4: Loss: 0.4487 Validation Accuracy: 0.738000 Epoch 52, CIFAR-10 Batch 5: Loss: 0.4403 Validation Accuracy: 0.734600 Epoch 53, CIFAR-10 Batch 1: Loss: 0.5766 Validation Accuracy: 0.763200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.4704 Validation Accuracy: 0.729800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.4499 Validation Accuracy: 0.741000 Epoch 53, CIFAR-10 Batch 4: Loss: 0.4448 Validation Accuracy: 0.741200 Epoch 53, CIFAR-10 Batch 5: Loss: 0.4325 Validation Accuracy: 0.714600 Epoch 54, CIFAR-10 Batch 1: Loss: 0.5587 Validation Accuracy: 0.753200 Epoch 54, CIFAR-10 Batch 2: Loss: 0.4600 Validation Accuracy: 0.744000 Epoch 54, CIFAR-10 Batch 3: Loss: 0.4466 Validation Accuracy: 0.723400 Epoch 54, CIFAR-10 Batch 4: Loss: 0.4332 Validation Accuracy: 0.747600 Epoch 54, CIFAR-10 Batch 5: Loss: 0.4247 Validation Accuracy: 0.735600 Epoch 55, CIFAR-10 Batch 1: Loss: 0.5463 Validation Accuracy: 0.751000 Epoch 55, CIFAR-10 Batch 2: Loss: 0.4538 Validation Accuracy: 0.735600 Epoch 55, CIFAR-10 Batch 3: Loss: 0.4447 Validation Accuracy: 0.742200 Epoch 55, CIFAR-10 Batch 4: Loss: 0.4273 Validation Accuracy: 0.747200 Epoch 55, CIFAR-10 Batch 5: Loss: 0.4107 Validation Accuracy: 0.734800 Epoch 56, CIFAR-10 Batch 1: Loss: 0.5375 Validation Accuracy: 0.754400 Epoch 56, CIFAR-10 Batch 2: Loss: 0.4420 Validation Accuracy: 0.734600 Epoch 56, CIFAR-10 Batch 3: Loss: 0.4344 Validation Accuracy: 0.749600 Epoch 56, CIFAR-10 Batch 4: Loss: 0.4192 Validation Accuracy: 0.746800 Epoch 56, CIFAR-10 Batch 5: Loss: 0.4064 Validation Accuracy: 0.740200 Epoch 57, CIFAR-10 Batch 1: Loss: 0.5258 Validation Accuracy: 0.769600 Epoch 57, CIFAR-10 Batch 2: Loss: 0.4338 Validation Accuracy: 0.736400 Epoch 57, CIFAR-10 Batch 3: Loss: 0.4278 Validation Accuracy: 0.756800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.4152 Validation Accuracy: 0.757200 Epoch 57, CIFAR-10 Batch 5: Loss: 0.4000 Validation Accuracy: 0.753600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.5178 Validation Accuracy: 0.775800 Epoch 58, CIFAR-10 Batch 2: Loss: 0.4270 Validation Accuracy: 0.745400 Epoch 58, CIFAR-10 Batch 3: Loss: 0.4197 Validation Accuracy: 0.755800 Epoch 58, CIFAR-10 Batch 4: Loss: 0.4055 Validation Accuracy: 0.734200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.3944 Validation Accuracy: 0.734000 Epoch 59, CIFAR-10 Batch 1: Loss: 0.5123 Validation Accuracy: 0.771200 Epoch 59, CIFAR-10 Batch 2: Loss: 0.4112 Validation Accuracy: 0.741200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.4127 Validation Accuracy: 0.748400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.3989 Validation Accuracy: 0.749600 Epoch 59, CIFAR-10 Batch 5: Loss: 0.3845 Validation Accuracy: 0.755400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.5016 Validation Accuracy: 0.775000 Epoch 60, CIFAR-10 Batch 2: Loss: 0.4037 Validation Accuracy: 0.760800 Epoch 60, CIFAR-10 Batch 3: Loss: 0.4028 Validation Accuracy: 0.763400 Epoch 60, CIFAR-10 Batch 4: Loss: 0.3909 Validation Accuracy: 0.762800 Epoch 60, CIFAR-10 Batch 5: Loss: 0.3699 Validation Accuracy: 0.754200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.4965 Validation Accuracy: 0.772000 Epoch 61, CIFAR-10 Batch 2: Loss: 0.3950 Validation Accuracy: 0.741800 Epoch 61, CIFAR-10 Batch 3: Loss: 0.3981 Validation Accuracy: 0.761400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.3830 Validation Accuracy: 0.744200 Epoch 61, CIFAR-10 Batch 5: Loss: 0.3647 Validation Accuracy: 0.748800 Epoch 62, CIFAR-10 Batch 1: Loss: 0.4767 Validation Accuracy: 0.790800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.3903 Validation Accuracy: 0.761000 Epoch 62, CIFAR-10 Batch 3: Loss: 0.3905 Validation Accuracy: 0.758800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.3768 Validation Accuracy: 0.764000 Epoch 62, CIFAR-10 Batch 5: Loss: 0.3497 Validation Accuracy: 0.762600 Epoch 63, CIFAR-10 Batch 1: Loss: 0.4705 Validation Accuracy: 0.774800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.3778 Validation Accuracy: 0.750400 Epoch 63, CIFAR-10 Batch 3: Loss: 0.3867 Validation Accuracy: 0.745600 Epoch 63, CIFAR-10 Batch 4: Loss: 0.3714 Validation Accuracy: 0.725400 Epoch 63, CIFAR-10 Batch 5: Loss: 0.3484 Validation Accuracy: 0.746200 Epoch 64, CIFAR-10 Batch 1: Loss: 0.4589 Validation Accuracy: 0.782600 Epoch 64, CIFAR-10 Batch 2: Loss: 0.3721 Validation Accuracy: 0.754000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.3715 Validation Accuracy: 0.756800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.3612 Validation Accuracy: 0.757000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.3355 Validation Accuracy: 0.760800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.4552 Validation Accuracy: 0.772400 Epoch 65, CIFAR-10 Batch 2: Loss: 0.3715 Validation Accuracy: 0.739200 Epoch 65, CIFAR-10 Batch 3: Loss: 0.3712 Validation Accuracy: 0.765800 Epoch 65, CIFAR-10 Batch 4: Loss: 0.3567 Validation Accuracy: 0.747600 Epoch 65, CIFAR-10 Batch 5: Loss: 0.3290 Validation Accuracy: 0.767200 Epoch 66, CIFAR-10 Batch 1: Loss: 0.4352 Validation Accuracy: 0.776000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.3571 Validation Accuracy: 0.750600 Epoch 66, CIFAR-10 Batch 3: Loss: 0.3616 Validation Accuracy: 0.752400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.3488 Validation Accuracy: 0.753600 Epoch 66, CIFAR-10 Batch 5: Loss: 0.3235 Validation Accuracy: 0.754000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.4400 Validation Accuracy: 0.788800 Epoch 67, CIFAR-10 Batch 2: Loss: 0.3517 Validation Accuracy: 0.758000 Epoch 67, CIFAR-10 Batch 3: Loss: 0.3672 Validation Accuracy: 0.740400 Epoch 67, CIFAR-10 Batch 4: Loss: 0.3489 Validation Accuracy: 0.743600 Epoch 67, CIFAR-10 Batch 5: Loss: 0.3256 Validation Accuracy: 0.766000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.4374 Validation Accuracy: 0.776800 Epoch 68, CIFAR-10 Batch 2: Loss: 0.3448 Validation Accuracy: 0.751400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.3531 Validation Accuracy: 0.768400 Epoch 68, CIFAR-10 Batch 4: Loss: 0.3442 Validation Accuracy: 0.752800 Epoch 68, CIFAR-10 Batch 5: Loss: 0.3127 Validation Accuracy: 0.755600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.4169 Validation Accuracy: 0.777200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.3349 Validation Accuracy: 0.757400 Epoch 69, CIFAR-10 Batch 3: Loss: 0.3441 Validation Accuracy: 0.747200 Epoch 69, CIFAR-10 Batch 4: Loss: 0.3351 Validation Accuracy: 0.751000 Epoch 69, CIFAR-10 Batch 5: Loss: 0.3088 Validation Accuracy: 0.769600 Epoch 70, CIFAR-10 Batch 1: Loss: 0.4069 Validation Accuracy: 0.776200 Epoch 70, CIFAR-10 Batch 2: Loss: 0.3337 Validation Accuracy: 0.766200 Epoch 70, CIFAR-10 Batch 3: Loss: 0.3356 Validation Accuracy: 0.752000 Epoch 70, CIFAR-10 Batch 4: Loss: 0.3294 Validation Accuracy: 0.766800 Epoch 70, CIFAR-10 Batch 5: Loss: 0.2963 Validation Accuracy: 0.775000 Epoch 71, CIFAR-10 Batch 1: Loss: 0.3907 Validation Accuracy: 0.783200 Epoch 71, CIFAR-10 Batch 2: Loss: 0.3316 Validation Accuracy: 0.749200 Epoch 71, CIFAR-10 Batch 3: Loss: 0.3325 Validation Accuracy: 0.745000 Epoch 71, CIFAR-10 Batch 4: Loss: 0.3247 Validation Accuracy: 0.744200 Epoch 71, CIFAR-10 Batch 5: Loss: 0.2930 Validation Accuracy: 0.759600 Epoch 72, CIFAR-10 Batch 1: Loss: 0.3884 Validation Accuracy: 0.773800 Epoch 72, CIFAR-10 Batch 2: Loss: 0.3243 Validation Accuracy: 0.750800 Epoch 72, CIFAR-10 Batch 3: Loss: 0.3260 Validation Accuracy: 0.762200 Epoch 72, CIFAR-10 Batch 4: Loss: 0.3160 Validation Accuracy: 0.753600 Epoch 72, CIFAR-10 Batch 5: Loss: 0.2888 Validation Accuracy: 0.784400 Epoch 73, CIFAR-10 Batch 1: Loss: 0.3748 Validation Accuracy: 0.790800 Epoch 73, CIFAR-10 Batch 2: Loss: 0.3173 Validation Accuracy: 0.768400 Epoch 73, CIFAR-10 Batch 3: Loss: 0.3180 Validation Accuracy: 0.768000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.3168 Validation Accuracy: 0.761400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.2836 Validation Accuracy: 0.748800 Epoch 74, CIFAR-10 Batch 1: Loss: 0.3786 Validation Accuracy: 0.777200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.3036 Validation Accuracy: 0.771400 Epoch 74, CIFAR-10 Batch 3: Loss: 0.3119 Validation Accuracy: 0.770200 Epoch 74, CIFAR-10 Batch 4: Loss: 0.3150 Validation Accuracy: 0.768600 Epoch 74, CIFAR-10 Batch 5: Loss: 0.2804 Validation Accuracy: 0.768200 Epoch 75, CIFAR-10 Batch 1: Loss: 0.3593 Validation Accuracy: 0.764800 Epoch 75, CIFAR-10 Batch 2: Loss: 0.2953 Validation Accuracy: 0.756200 Epoch 75, CIFAR-10 Batch 3: Loss: 0.3036 Validation Accuracy: 0.767400 Epoch 75, CIFAR-10 Batch 4: Loss: 0.3015 Validation Accuracy: 0.770400 Epoch 75, CIFAR-10 Batch 5: Loss: 0.2679 Validation Accuracy: 0.783600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.3567 Validation Accuracy: 0.791400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.2875 Validation Accuracy: 0.754400 Epoch 76, CIFAR-10 Batch 3: Loss: 0.2928 Validation Accuracy: 0.774800 Epoch 76, CIFAR-10 Batch 4: Loss: 0.3019 Validation Accuracy: 0.747600 Epoch 76, CIFAR-10 Batch 5: Loss: 0.2653 Validation Accuracy: 0.777800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.3496 Validation Accuracy: 0.780400 Epoch 77, CIFAR-10 Batch 2: Loss: 0.2854 Validation Accuracy: 0.760000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.2933 Validation Accuracy: 0.758800 Epoch 77, CIFAR-10 Batch 4: Loss: 0.2935 Validation Accuracy: 0.756800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.2608 Validation Accuracy: 0.786400 Epoch 78, CIFAR-10 Batch 1: Loss: 0.3385 Validation Accuracy: 0.789400 Epoch 78, CIFAR-10 Batch 2: Loss: 0.2757 Validation Accuracy: 0.766000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.2940 Validation Accuracy: 0.753000 Epoch 78, CIFAR-10 Batch 4: Loss: 0.2995 Validation Accuracy: 0.751200 Epoch 78, CIFAR-10 Batch 5: Loss: 0.2560 Validation Accuracy: 0.770000 Epoch 79, CIFAR-10 Batch 1: Loss: 0.3317 Validation Accuracy: 0.785600 Epoch 79, CIFAR-10 Batch 2: Loss: 0.2700 Validation Accuracy: 0.773800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.2857 Validation Accuracy: 0.763800 Epoch 79, CIFAR-10 Batch 4: Loss: 0.2826 Validation Accuracy: 0.776400 Epoch 79, CIFAR-10 Batch 5: Loss: 0.2504 Validation Accuracy: 0.803000 Epoch 80, CIFAR-10 Batch 1: Loss: 0.3202 Validation Accuracy: 0.803200 Epoch 80, CIFAR-10 Batch 2: Loss: 0.2643 Validation Accuracy: 0.774600 Epoch 80, CIFAR-10 Batch 3: Loss: 0.2755 Validation Accuracy: 0.764600 Epoch 80, CIFAR-10 Batch 4: Loss: 0.2855 Validation Accuracy: 0.761400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.2494 Validation Accuracy: 0.778200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.3292 Validation Accuracy: 0.782800 Epoch 81, CIFAR-10 Batch 2: Loss: 0.2568 Validation Accuracy: 0.769000 Epoch 81, CIFAR-10 Batch 3: Loss: 0.2670 Validation Accuracy: 0.766800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.2751 Validation Accuracy: 0.772800 Epoch 81, CIFAR-10 Batch 5: Loss: 0.2408 Validation Accuracy: 0.800800 Epoch 82, CIFAR-10 Batch 1: Loss: 0.3323 Validation Accuracy: 0.795000 Epoch 82, CIFAR-10 Batch 2: Loss: 0.2491 Validation Accuracy: 0.795400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.2645 Validation Accuracy: 0.794200 Epoch 82, CIFAR-10 Batch 4: Loss: 0.2571 Validation Accuracy: 0.792800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.2319 Validation Accuracy: 0.792200 Epoch 83, CIFAR-10 Batch 1: Loss: 0.3222 Validation Accuracy: 0.791400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.2437 Validation Accuracy: 0.791800 Epoch 83, CIFAR-10 Batch 3: Loss: 0.2596 Validation Accuracy: 0.791400 Epoch 83, CIFAR-10 Batch 4: Loss: 0.2541 Validation Accuracy: 0.793600 Epoch 83, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 84, CIFAR-10 Batch 1: Loss: 0.3196 Validation Accuracy: 0.793400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.2422 Validation Accuracy: 0.794200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793600 Epoch 84, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793800 Epoch 84, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 85, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.793000 Epoch 85, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 85, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 85, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 86, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.793000 Epoch 86, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 86, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 86, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 86, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 87, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 87, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 87, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 87, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 87, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 88, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 88, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 88, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 88, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 89, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 89, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 89, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 90, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 90, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 90, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 90, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 90, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 91, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 91, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 91, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 92, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 92, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 92, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 92, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 92, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 93, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.793000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 93, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 93, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 94, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 94, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792400 Epoch 94, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 94, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 94, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 95, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 95, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 95, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 96, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 96, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 96, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 96, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 97, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 97, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 97, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 97, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 97, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 98, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 98, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 98, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 98, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 98, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 99, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 99, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 99, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 99, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 99, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 100, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792400 Epoch 100, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 100, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 100, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 101, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 101, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 101, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 101, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 102, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 102, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 102, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 102, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 102, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 103, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.793200 Epoch 103, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 103, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 103, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 103, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 104, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 104, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 104, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 104, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 105, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 105, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 105, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 105, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 106, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 106, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 107, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 107, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 107, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 107, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793600 Epoch 107, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 108, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 108, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 108, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 108, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 108, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 109, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 109, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 109, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 110, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793200 Epoch 110, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 110, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 111, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 111, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 111, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 111, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 112, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 112, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 112, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 113, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 113, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 113, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 113, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 114, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 114, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 114, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 114, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 114, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 115, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 115, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 115, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792400 Epoch 115, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792400 Epoch 115, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 116, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 116, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 116, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 116, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 117, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 117, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 117, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 117, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 117, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 118, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 118, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 118, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 118, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 119, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 119, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 119, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 119, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 120, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 120, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 120, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 120, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 120, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 121, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 121, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 121, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 121, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 122, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 122, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 123, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 123, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 123, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 124, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 124, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 124, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 124, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 125, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 125, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 125, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 125, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 126, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 126, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 126, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 126, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 127, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 127, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 127, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 127, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792400 Epoch 127, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 128, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 128, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 128, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 128, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 129, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 129, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 129, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 129, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 130, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 130, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 130, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 130, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 130, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 131, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 131, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 131, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 131, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 131, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 132, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 132, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 132, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 132, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 132, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 133, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 133, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 133, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 133, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 133, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793200 Epoch 134, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 134, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 134, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 134, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 134, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 135, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 135, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 135, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 135, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 135, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 136, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 136, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 137, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 137, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 137, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 137, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 138, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 138, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 138, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 139, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 139, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 139, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 139, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 140, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 140, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 140, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 140, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 140, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 141, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 141, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 141, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 142, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 142, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 142, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 142, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 142, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 143, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 143, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 144, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 144, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 144, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 144, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 145, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 145, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 145, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 145, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 145, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 146, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 146, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 146, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 147, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 147, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 147, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 148, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 148, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 148, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 148, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 149, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 149, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 149, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 149, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 149, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 150, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 150, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 150, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 150, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 150, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 151, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 151, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793200 Epoch 152, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 152, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 152, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 152, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 152, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 153, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 153, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 153, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 153, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 154, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792600 Epoch 154, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 154, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 155, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 155, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.793000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 155, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 156, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 156, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 156, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 157, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 157, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793200 Epoch 157, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 158, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 158, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 158, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 158, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793400 Epoch 158, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 159, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 159, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 159, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793400 Epoch 160, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 160, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 160, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 160, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 160, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 161, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 161, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.793000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 161, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 162, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 162, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 162, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792600 Epoch 162, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Epoch 163, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792800 Epoch 163, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 163, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792800 Epoch 163, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.792800 Epoch 163, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793600 Epoch 164, CIFAR-10 Batch 1: Loss: 0.3194 Validation Accuracy: 0.792600 Epoch 164, CIFAR-10 Batch 2: Loss: 0.2421 Validation Accuracy: 0.792800 Epoch 164, CIFAR-10 Batch 3: Loss: 0.2588 Validation Accuracy: 0.792600 Epoch 164, CIFAR-10 Batch 4: Loss: 0.2537 Validation Accuracy: 0.793000 Epoch 164, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.793800 Training for learning_rate=0.10000, batch_size=256 ... Epoch 1, CIFAR-10 Batch 1: Loss: 2.1782 Validation Accuracy: 0.106800 Epoch 1, CIFAR-10 Batch 2: Loss: 1.9778 Validation Accuracy: 0.133200 Epoch 1, CIFAR-10 Batch 3: Loss: 1.8560 Validation Accuracy: 0.113800 Epoch 1, CIFAR-10 Batch 4: Loss: 1.7454 Validation Accuracy: 0.192800 Epoch 1, CIFAR-10 Batch 5: Loss: 1.6454 Validation Accuracy: 0.167400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.5697 Validation Accuracy: 0.165600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.7089 Validation Accuracy: 0.139400 Epoch 2, CIFAR-10 Batch 3: Loss: 1.6343 Validation Accuracy: 0.270400 Epoch 2, CIFAR-10 Batch 4: Loss: 1.4479 Validation Accuracy: 0.349200 Epoch 2, CIFAR-10 Batch 5: Loss: 1.3166 Validation Accuracy: 0.161400 Epoch 3, CIFAR-10 Batch 1: Loss: 1.2279 Validation Accuracy: 0.215400 Epoch 3, CIFAR-10 Batch 2: Loss: 1.5548 Validation Accuracy: 0.361600 Epoch 3, CIFAR-10 Batch 3: Loss: 1.5248 Validation Accuracy: 0.341000 Epoch 3, CIFAR-10 Batch 4: Loss: 1.3304 Validation Accuracy: 0.339800 Epoch 3, CIFAR-10 Batch 5: Loss: 1.2116 Validation Accuracy: 0.481600 Epoch 4, CIFAR-10 Batch 1: Loss: 1.1146 Validation Accuracy: 0.234400 Epoch 4, CIFAR-10 Batch 2: Loss: 1.4649 Validation Accuracy: 0.327000 Epoch 4, CIFAR-10 Batch 3: Loss: 1.4424 Validation Accuracy: 0.381600 Epoch 4, CIFAR-10 Batch 4: Loss: 1.2060 Validation Accuracy: 0.275400 Epoch 4, CIFAR-10 Batch 5: Loss: 1.2406 Validation Accuracy: 0.416000 Epoch 5, CIFAR-10 Batch 1: Loss: 1.0616 Validation Accuracy: 0.323200 Epoch 5, CIFAR-10 Batch 2: Loss: 1.3959 Validation Accuracy: 0.452600 Epoch 5, CIFAR-10 Batch 3: Loss: 1.3311 Validation Accuracy: 0.310600 Epoch 5, CIFAR-10 Batch 4: Loss: 1.1797 Validation Accuracy: 0.314000 Epoch 5, CIFAR-10 Batch 5: Loss: 1.1767 Validation Accuracy: 0.387600 Epoch 6, CIFAR-10 Batch 1: Loss: 1.0420 Validation Accuracy: 0.404000 Epoch 6, CIFAR-10 Batch 2: Loss: 1.3183 Validation Accuracy: 0.402200 Epoch 6, CIFAR-10 Batch 3: Loss: 1.3246 Validation Accuracy: 0.426800 Epoch 6, CIFAR-10 Batch 4: Loss: 1.1613 Validation Accuracy: 0.369000 Epoch 6, CIFAR-10 Batch 5: Loss: 1.0944 Validation Accuracy: 0.552200 Epoch 7, CIFAR-10 Batch 1: Loss: 0.9540 Validation Accuracy: 0.328200 Epoch 7, CIFAR-10 Batch 2: Loss: 1.2649 Validation Accuracy: 0.419000 Epoch 7, CIFAR-10 Batch 3: Loss: 1.2129 Validation Accuracy: 0.460200 Epoch 7, CIFAR-10 Batch 4: Loss: 1.1818 Validation Accuracy: 0.203800 Epoch 7, CIFAR-10 Batch 5: Loss: 1.0150 Validation Accuracy: 0.539200 Epoch 8, CIFAR-10 Batch 1: Loss: 0.9477 Validation Accuracy: 0.420600 Epoch 8, CIFAR-10 Batch 2: Loss: 1.2415 Validation Accuracy: 0.399400 Epoch 8, CIFAR-10 Batch 3: Loss: 1.2355 Validation Accuracy: 0.153800 Epoch 8, CIFAR-10 Batch 4: Loss: 1.1866 Validation Accuracy: 0.498000 Epoch 8, CIFAR-10 Batch 5: Loss: 1.0641 Validation Accuracy: 0.332200 Epoch 9, CIFAR-10 Batch 1: Loss: 0.9874 Validation Accuracy: 0.519200 Epoch 9, CIFAR-10 Batch 2: Loss: 1.2151 Validation Accuracy: 0.551600 Epoch 9, CIFAR-10 Batch 3: Loss: 1.2353 Validation Accuracy: 0.432600 Epoch 9, CIFAR-10 Batch 4: Loss: 1.0968 Validation Accuracy: 0.376600 Epoch 9, CIFAR-10 Batch 5: Loss: 1.0259 Validation Accuracy: 0.535800 Epoch 10, CIFAR-10 Batch 1: Loss: 0.9037 Validation Accuracy: 0.476800 Epoch 10, CIFAR-10 Batch 2: Loss: 1.1230 Validation Accuracy: 0.408000 Epoch 10, CIFAR-10 Batch 3: Loss: 1.2094 Validation Accuracy: 0.539000 Epoch 10, CIFAR-10 Batch 4: Loss: 1.0136 Validation Accuracy: 0.373200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.9441 Validation Accuracy: 0.542800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.9613 Validation Accuracy: 0.547600 Epoch 11, CIFAR-10 Batch 2: Loss: 1.1918 Validation Accuracy: 0.508000 Epoch 11, CIFAR-10 Batch 3: Loss: 1.1433 Validation Accuracy: 0.567000 Epoch 11, CIFAR-10 Batch 4: Loss: 1.0299 Validation Accuracy: 0.584800 Epoch 11, CIFAR-10 Batch 5: Loss: 0.9116 Validation Accuracy: 0.566400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.8872 Validation Accuracy: 0.441400 Epoch 12, CIFAR-10 Batch 2: Loss: 1.2117 Validation Accuracy: 0.491200 Epoch 12, CIFAR-10 Batch 3: Loss: 1.1663 Validation Accuracy: 0.440400 Epoch 12, CIFAR-10 Batch 4: Loss: 0.9693 Validation Accuracy: 0.545600 Epoch 12, CIFAR-10 Batch 5: Loss: 0.9027 Validation Accuracy: 0.509200 Epoch 13, CIFAR-10 Batch 1: Loss: 0.8381 Validation Accuracy: 0.555800 Epoch 13, CIFAR-10 Batch 2: Loss: 1.1252 Validation Accuracy: 0.462800 Epoch 13, CIFAR-10 Batch 3: Loss: 1.1587 Validation Accuracy: 0.346200 Epoch 13, CIFAR-10 Batch 4: Loss: 0.9312 Validation Accuracy: 0.532000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.8362 Validation Accuracy: 0.586400 Epoch 14, CIFAR-10 Batch 1: Loss: 0.9314 Validation Accuracy: 0.424200 Epoch 14, CIFAR-10 Batch 2: Loss: 1.0835 Validation Accuracy: 0.302400 Epoch 14, CIFAR-10 Batch 3: Loss: 1.1205 Validation Accuracy: 0.514200 Epoch 14, CIFAR-10 Batch 4: Loss: 0.9417 Validation Accuracy: 0.456000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.8644 Validation Accuracy: 0.484200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.8237 Validation Accuracy: 0.510600 Epoch 15, CIFAR-10 Batch 2: Loss: 1.0800 Validation Accuracy: 0.472800 Epoch 15, CIFAR-10 Batch 3: Loss: 1.0907 Validation Accuracy: 0.361400 Epoch 15, CIFAR-10 Batch 4: Loss: 1.0062 Validation Accuracy: 0.429000 Epoch 15, CIFAR-10 Batch 5: Loss: 0.8568 Validation Accuracy: 0.359800 Epoch 16, CIFAR-10 Batch 1: Loss: 0.8233 Validation Accuracy: 0.457200 Epoch 16, CIFAR-10 Batch 2: Loss: 1.0829 Validation Accuracy: 0.376200 Epoch 16, CIFAR-10 Batch 3: Loss: 1.0982 Validation Accuracy: 0.521200 Epoch 16, CIFAR-10 Batch 4: Loss: 0.8620 Validation Accuracy: 0.484200 Epoch 16, CIFAR-10 Batch 5: Loss: 0.9156 Validation Accuracy: 0.382800 Epoch 17, CIFAR-10 Batch 1: Loss: 0.8720 Validation Accuracy: 0.478400 Epoch 17, CIFAR-10 Batch 2: Loss: 1.1096 Validation Accuracy: 0.574800 Epoch 17, CIFAR-10 Batch 3: Loss: 1.0598 Validation Accuracy: 0.570400 Epoch 17, CIFAR-10 Batch 4: Loss: 0.8933 Validation Accuracy: 0.574400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.7833 Validation Accuracy: 0.584800 Epoch 18, CIFAR-10 Batch 1: Loss: 0.8505 Validation Accuracy: 0.452800 Epoch 18, CIFAR-10 Batch 2: Loss: 1.0658 Validation Accuracy: 0.383600 Epoch 18, CIFAR-10 Batch 3: Loss: 1.1062 Validation Accuracy: 0.441600 Epoch 18, CIFAR-10 Batch 4: Loss: 0.8740 Validation Accuracy: 0.489000 Epoch 18, CIFAR-10 Batch 5: Loss: 0.8076 Validation Accuracy: 0.371000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.8572 Validation Accuracy: 0.438200 Epoch 19, CIFAR-10 Batch 2: Loss: 1.0610 Validation Accuracy: 0.594000 Epoch 19, CIFAR-10 Batch 3: Loss: 1.0961 Validation Accuracy: 0.516000 Epoch 19, CIFAR-10 Batch 4: Loss: 0.7948 Validation Accuracy: 0.588200 Epoch 19, CIFAR-10 Batch 5: Loss: 0.8367 Validation Accuracy: 0.633800 Epoch 20, CIFAR-10 Batch 1: Loss: 0.7988 Validation Accuracy: 0.498000 Epoch 20, CIFAR-10 Batch 2: Loss: 1.0015 Validation Accuracy: 0.549200 Epoch 20, CIFAR-10 Batch 3: Loss: 1.0293 Validation Accuracy: 0.441600 Epoch 20, CIFAR-10 Batch 4: Loss: 0.8208 Validation Accuracy: 0.592200 Epoch 20, CIFAR-10 Batch 5: Loss: 0.8034 Validation Accuracy: 0.588400 Epoch 21, CIFAR-10 Batch 1: Loss: 0.7644 Validation Accuracy: 0.516800 Epoch 21, CIFAR-10 Batch 2: Loss: 0.9562 Validation Accuracy: 0.610000 Epoch 21, CIFAR-10 Batch 3: Loss: 0.9994 Validation Accuracy: 0.529200 Epoch 21, CIFAR-10 Batch 4: Loss: 0.7972 Validation Accuracy: 0.565600 Epoch 21, CIFAR-10 Batch 5: Loss: 0.8097 Validation Accuracy: 0.532800 Epoch 22, CIFAR-10 Batch 1: Loss: 0.6973 Validation Accuracy: 0.548800 Epoch 22, CIFAR-10 Batch 2: Loss: 1.0661 Validation Accuracy: 0.356000 Epoch 22, CIFAR-10 Batch 3: Loss: 1.0194 Validation Accuracy: 0.604600 Epoch 22, CIFAR-10 Batch 4: Loss: 0.7620 Validation Accuracy: 0.556200 Epoch 22, CIFAR-10 Batch 5: Loss: 0.8379 Validation Accuracy: 0.421600 Epoch 23, CIFAR-10 Batch 1: Loss: 0.7381 Validation Accuracy: 0.598600 Epoch 23, CIFAR-10 Batch 2: Loss: 0.9436 Validation Accuracy: 0.549200 Epoch 23, CIFAR-10 Batch 3: Loss: 0.9949 Validation Accuracy: 0.428400 Epoch 23, CIFAR-10 Batch 4: Loss: 0.8822 Validation Accuracy: 0.625200 Epoch 23, CIFAR-10 Batch 5: Loss: 0.7176 Validation Accuracy: 0.496200 Epoch 24, CIFAR-10 Batch 1: Loss: 0.7598 Validation Accuracy: 0.598200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.9411 Validation Accuracy: 0.595800 Epoch 24, CIFAR-10 Batch 3: Loss: 0.9671 Validation Accuracy: 0.470400 Epoch 24, CIFAR-10 Batch 4: Loss: 0.8085 Validation Accuracy: 0.597000 Epoch 24, CIFAR-10 Batch 5: Loss: 0.6667 Validation Accuracy: 0.553600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.7876 Validation Accuracy: 0.550200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.8856 Validation Accuracy: 0.565800 Epoch 25, CIFAR-10 Batch 3: Loss: 1.0135 Validation Accuracy: 0.577200 Epoch 25, CIFAR-10 Batch 4: Loss: 0.8200 Validation Accuracy: 0.585800 Epoch 25, CIFAR-10 Batch 5: Loss: 0.8531 Validation Accuracy: 0.383600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.7539 Validation Accuracy: 0.515200 Epoch 26, CIFAR-10 Batch 2: Loss: 0.9070 Validation Accuracy: 0.488000 Epoch 26, CIFAR-10 Batch 3: Loss: 0.9531 Validation Accuracy: 0.537400 Epoch 26, CIFAR-10 Batch 4: Loss: 0.7419 Validation Accuracy: 0.474000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.7220 Validation Accuracy: 0.483200 Epoch 27, CIFAR-10 Batch 1: Loss: 0.7622 Validation Accuracy: 0.358600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.9470 Validation Accuracy: 0.520800 Epoch 27, CIFAR-10 Batch 3: Loss: 0.9750 Validation Accuracy: 0.486400 Epoch 27, CIFAR-10 Batch 4: Loss: 0.7620 Validation Accuracy: 0.586000 Epoch 27, CIFAR-10 Batch 5: Loss: 0.7800 Validation Accuracy: 0.647200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.7414 Validation Accuracy: 0.617800 Epoch 28, CIFAR-10 Batch 2: Loss: 0.8936 Validation Accuracy: 0.587000 Epoch 28, CIFAR-10 Batch 3: Loss: 0.9787 Validation Accuracy: 0.569400 Epoch 28, CIFAR-10 Batch 4: Loss: 0.7410 Validation Accuracy: 0.618800 Epoch 28, CIFAR-10 Batch 5: Loss: 0.7416 Validation Accuracy: 0.595600 Epoch 29, CIFAR-10 Batch 1: Loss: 0.7387 Validation Accuracy: 0.599200 Epoch 29, CIFAR-10 Batch 2: Loss: 0.9023 Validation Accuracy: 0.588800 Epoch 29, CIFAR-10 Batch 3: Loss: 0.9896 Validation Accuracy: 0.581800 Epoch 29, CIFAR-10 Batch 4: Loss: 0.7793 Validation Accuracy: 0.565400 Epoch 29, CIFAR-10 Batch 5: Loss: 0.6872 Validation Accuracy: 0.481200 Epoch 30, CIFAR-10 Batch 1: Loss: 0.7355 Validation Accuracy: 0.645400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.8237 Validation Accuracy: 0.538800 Epoch 30, CIFAR-10 Batch 3: Loss: 0.9614 Validation Accuracy: 0.642000 Epoch 30, CIFAR-10 Batch 4: Loss: 0.7428 Validation Accuracy: 0.620800 Epoch 30, CIFAR-10 Batch 5: Loss: 0.6568 Validation Accuracy: 0.453000 Epoch 31, CIFAR-10 Batch 1: Loss: 0.7205 Validation Accuracy: 0.641000 Epoch 31, CIFAR-10 Batch 2: Loss: 0.8377 Validation Accuracy: 0.621200 Epoch 31, CIFAR-10 Batch 3: Loss: 0.9148 Validation Accuracy: 0.454400 Epoch 31, CIFAR-10 Batch 4: Loss: 0.7451 Validation Accuracy: 0.548400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.7063 Validation Accuracy: 0.483800 Epoch 32, CIFAR-10 Batch 1: Loss: 0.6823 Validation Accuracy: 0.513000 Epoch 32, CIFAR-10 Batch 2: Loss: 0.8526 Validation Accuracy: 0.552600 Epoch 32, CIFAR-10 Batch 3: Loss: 0.9644 Validation Accuracy: 0.653400 Epoch 32, CIFAR-10 Batch 4: Loss: 0.7297 Validation Accuracy: 0.576800 Epoch 32, CIFAR-10 Batch 5: Loss: 0.6371 Validation Accuracy: 0.595400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.6944 Validation Accuracy: 0.601800 Epoch 33, CIFAR-10 Batch 2: Loss: 0.8672 Validation Accuracy: 0.481800 Epoch 33, CIFAR-10 Batch 3: Loss: 0.8890 Validation Accuracy: 0.531000 Epoch 33, CIFAR-10 Batch 4: Loss: 0.7542 Validation Accuracy: 0.584400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.6756 Validation Accuracy: 0.647800 Epoch 34, CIFAR-10 Batch 1: Loss: 0.6687 Validation Accuracy: 0.564400 Epoch 34, CIFAR-10 Batch 2: Loss: 0.8551 Validation Accuracy: 0.564800 Epoch 34, CIFAR-10 Batch 3: Loss: 0.9232 Validation Accuracy: 0.592200 Epoch 34, CIFAR-10 Batch 4: Loss: 0.6926 Validation Accuracy: 0.624600 Epoch 34, CIFAR-10 Batch 5: Loss: 0.6911 Validation Accuracy: 0.598800 Epoch 35, CIFAR-10 Batch 1: Loss: 0.6726 Validation Accuracy: 0.557600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.7996 Validation Accuracy: 0.570000 Epoch 35, CIFAR-10 Batch 3: Loss: 0.8787 Validation Accuracy: 0.650400 Epoch 35, CIFAR-10 Batch 4: Loss: 0.6968 Validation Accuracy: 0.610200 Epoch 35, CIFAR-10 Batch 5: Loss: 0.6083 Validation Accuracy: 0.601600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.6626 Validation Accuracy: 0.649000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.8262 Validation Accuracy: 0.607400 Epoch 36, CIFAR-10 Batch 3: Loss: 0.9371 Validation Accuracy: 0.557600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.7021 Validation Accuracy: 0.655200 Epoch 36, CIFAR-10 Batch 5: Loss: 0.6334 Validation Accuracy: 0.579000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.7123 Validation Accuracy: 0.592400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.7730 Validation Accuracy: 0.559600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.9582 Validation Accuracy: 0.455000 Epoch 37, CIFAR-10 Batch 4: Loss: 0.6894 Validation Accuracy: 0.605800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.6809 Validation Accuracy: 0.646800 Epoch 38, CIFAR-10 Batch 1: Loss: 0.6428 Validation Accuracy: 0.619400 Epoch 38, CIFAR-10 Batch 2: Loss: 0.8806 Validation Accuracy: 0.539000 Epoch 38, CIFAR-10 Batch 3: Loss: 0.9386 Validation Accuracy: 0.472000 Epoch 38, CIFAR-10 Batch 4: Loss: 0.7260 Validation Accuracy: 0.580000 Epoch 38, CIFAR-10 Batch 5: Loss: 0.6093 Validation Accuracy: 0.591000 Epoch 39, CIFAR-10 Batch 1: Loss: 0.6243 Validation Accuracy: 0.609400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.8048 Validation Accuracy: 0.653600 Epoch 39, CIFAR-10 Batch 3: Loss: 0.9423 Validation Accuracy: 0.591000 Epoch 39, CIFAR-10 Batch 4: Loss: 0.6641 Validation Accuracy: 0.616800 Epoch 39, CIFAR-10 Batch 5: Loss: 0.6377 Validation Accuracy: 0.623200 Epoch 40, CIFAR-10 Batch 1: Loss: 0.6642 Validation Accuracy: 0.448400 Epoch 40, CIFAR-10 Batch 2: Loss: 0.7881 Validation Accuracy: 0.561600 Epoch 40, CIFAR-10 Batch 3: Loss: 0.9736 Validation Accuracy: 0.566600 Epoch 40, CIFAR-10 Batch 4: Loss: 0.7030 Validation Accuracy: 0.665000 Epoch 40, CIFAR-10 Batch 5: Loss: 0.6106 Validation Accuracy: 0.425600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.6446 Validation Accuracy: 0.641600 Epoch 41, CIFAR-10 Batch 2: Loss: 0.7565 Validation Accuracy: 0.503800 Epoch 41, CIFAR-10 Batch 3: Loss: 0.9329 Validation Accuracy: 0.361800 Epoch 41, CIFAR-10 Batch 4: Loss: 0.7162 Validation Accuracy: 0.684000 Epoch 41, CIFAR-10 Batch 5: Loss: 0.6070 Validation Accuracy: 0.540800 Epoch 42, CIFAR-10 Batch 1: Loss: 0.6248 Validation Accuracy: 0.639800 Epoch 42, CIFAR-10 Batch 2: Loss: 0.7861 Validation Accuracy: 0.530000 Epoch 42, CIFAR-10 Batch 3: Loss: 0.8818 Validation Accuracy: 0.578400 Epoch 42, CIFAR-10 Batch 4: Loss: 0.6972 Validation Accuracy: 0.651400 Epoch 42, CIFAR-10 Batch 5: Loss: 0.5520 Validation Accuracy: 0.490400 Epoch 43, CIFAR-10 Batch 1: Loss: 0.6341 Validation Accuracy: 0.650800 Epoch 43, CIFAR-10 Batch 2: Loss: 0.7782 Validation Accuracy: 0.518400 Epoch 43, CIFAR-10 Batch 3: Loss: 0.8941 Validation Accuracy: 0.565400 Epoch 43, CIFAR-10 Batch 4: Loss: 0.6745 Validation Accuracy: 0.626200 Epoch 43, CIFAR-10 Batch 5: Loss: 0.5626 Validation Accuracy: 0.507800 Epoch 44, CIFAR-10 Batch 1: Loss: 0.6497 Validation Accuracy: 0.470800 Epoch 44, CIFAR-10 Batch 2: Loss: 0.8071 Validation Accuracy: 0.496000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.9094 Validation Accuracy: 0.628800 Epoch 44, CIFAR-10 Batch 4: Loss: 0.6877 Validation Accuracy: 0.605800 Epoch 44, CIFAR-10 Batch 5: Loss: 0.5768 Validation Accuracy: 0.559200 Epoch 45, CIFAR-10 Batch 1: Loss: 0.6675 Validation Accuracy: 0.422000 Epoch 45, CIFAR-10 Batch 2: Loss: 0.8148 Validation Accuracy: 0.521400 Epoch 45, CIFAR-10 Batch 3: Loss: 0.9003 Validation Accuracy: 0.565800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.6722 Validation Accuracy: 0.547000 Epoch 45, CIFAR-10 Batch 5: Loss: 0.5549 Validation Accuracy: 0.431800 Epoch 46, CIFAR-10 Batch 1: Loss: 0.6351 Validation Accuracy: 0.503800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.7489 Validation Accuracy: 0.687600 Epoch 46, CIFAR-10 Batch 3: Loss: 0.8917 Validation Accuracy: 0.660600 Epoch 46, CIFAR-10 Batch 4: Loss: 0.6482 Validation Accuracy: 0.625800 Epoch 46, CIFAR-10 Batch 5: Loss: 0.5571 Validation Accuracy: 0.525200 Epoch 47, CIFAR-10 Batch 1: Loss: 0.6359 Validation Accuracy: 0.598400 Epoch 47, CIFAR-10 Batch 2: Loss: 0.7561 Validation Accuracy: 0.400800 Epoch 47, CIFAR-10 Batch 3: Loss: 0.8856 Validation Accuracy: 0.386600 Epoch 47, CIFAR-10 Batch 4: Loss: 0.6667 Validation Accuracy: 0.639800 Epoch 47, CIFAR-10 Batch 5: Loss: 0.5213 Validation Accuracy: 0.613600 Epoch 48, CIFAR-10 Batch 1: Loss: 0.6096 Validation Accuracy: 0.618200 Epoch 48, CIFAR-10 Batch 2: Loss: 0.7485 Validation Accuracy: 0.613200 Epoch 48, CIFAR-10 Batch 3: Loss: 0.8945 Validation Accuracy: 0.678400 Epoch 48, CIFAR-10 Batch 4: Loss: 0.6923 Validation Accuracy: 0.468800 Epoch 48, CIFAR-10 Batch 5: Loss: 0.5799 Validation Accuracy: 0.617400 Epoch 49, CIFAR-10 Batch 1: Loss: 0.6444 Validation Accuracy: 0.595600 Epoch 49, CIFAR-10 Batch 2: Loss: 0.8023 Validation Accuracy: 0.630800 Epoch 49, CIFAR-10 Batch 3: Loss: 0.9071 Validation Accuracy: 0.596400 Epoch 49, CIFAR-10 Batch 4: Loss: 0.6968 Validation Accuracy: 0.622400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.6232 Validation Accuracy: 0.564000 Epoch 50, CIFAR-10 Batch 1: Loss: 0.6187 Validation Accuracy: 0.564600 Epoch 50, CIFAR-10 Batch 2: Loss: 0.7510 Validation Accuracy: 0.687000 Epoch 50, CIFAR-10 Batch 3: Loss: 0.9166 Validation Accuracy: 0.611400 Epoch 50, CIFAR-10 Batch 4: Loss: 0.6541 Validation Accuracy: 0.511600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.5386 Validation Accuracy: 0.610200 Epoch 51, CIFAR-10 Batch 1: Loss: 0.6490 Validation Accuracy: 0.625400 Epoch 51, CIFAR-10 Batch 2: Loss: 0.7568 Validation Accuracy: 0.331000 Epoch 51, CIFAR-10 Batch 3: Loss: 0.8635 Validation Accuracy: 0.598600 Epoch 51, CIFAR-10 Batch 4: Loss: 0.6629 Validation Accuracy: 0.677200 Epoch 51, CIFAR-10 Batch 5: Loss: 0.5662 Validation Accuracy: 0.617400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.6178 Validation Accuracy: 0.604200 Epoch 52, CIFAR-10 Batch 2: Loss: 0.7357 Validation Accuracy: 0.659400 Epoch 52, CIFAR-10 Batch 3: Loss: 0.8718 Validation Accuracy: 0.618800 Epoch 52, CIFAR-10 Batch 4: Loss: 0.6679 Validation Accuracy: 0.654200 Epoch 52, CIFAR-10 Batch 5: Loss: 0.5642 Validation Accuracy: 0.564400 Epoch 53, CIFAR-10 Batch 1: Loss: 0.6096 Validation Accuracy: 0.488200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.7159 Validation Accuracy: 0.466400 Epoch 53, CIFAR-10 Batch 3: Loss: 0.8673 Validation Accuracy: 0.662400 Epoch 53, CIFAR-10 Batch 4: Loss: 0.6474 Validation Accuracy: 0.632000 Epoch 53, CIFAR-10 Batch 5: Loss: 0.5328 Validation Accuracy: 0.593600 Epoch 54, CIFAR-10 Batch 1: Loss: 0.6155 Validation Accuracy: 0.625400 Epoch 54, CIFAR-10 Batch 2: Loss: 0.7510 Validation Accuracy: 0.589400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.9158 Validation Accuracy: 0.587200 Epoch 54, CIFAR-10 Batch 4: Loss: 0.6620 Validation Accuracy: 0.460600 Epoch 54, CIFAR-10 Batch 5: Loss: 0.5985 Validation Accuracy: 0.656000 Epoch 55, CIFAR-10 Batch 1: Loss: 0.6238 Validation Accuracy: 0.686600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.7479 Validation Accuracy: 0.609600 Epoch 55, CIFAR-10 Batch 3: Loss: 0.8381 Validation Accuracy: 0.606400 Epoch 55, CIFAR-10 Batch 4: Loss: 0.6781 Validation Accuracy: 0.673400 Epoch 55, CIFAR-10 Batch 5: Loss: 0.5982 Validation Accuracy: 0.524800 Epoch 56, CIFAR-10 Batch 1: Loss: 0.6331 Validation Accuracy: 0.543400 Epoch 56, CIFAR-10 Batch 2: Loss: 0.7160 Validation Accuracy: 0.618200 Epoch 56, CIFAR-10 Batch 3: Loss: 0.8874 Validation Accuracy: 0.554400 Epoch 56, CIFAR-10 Batch 4: Loss: 0.6636 Validation Accuracy: 0.673600 Epoch 56, CIFAR-10 Batch 5: Loss: 0.5453 Validation Accuracy: 0.548400 Epoch 57, CIFAR-10 Batch 1: Loss: 0.6078 Validation Accuracy: 0.503200 Epoch 57, CIFAR-10 Batch 2: Loss: 0.7309 Validation Accuracy: 0.624200 Epoch 57, CIFAR-10 Batch 3: Loss: 0.8602 Validation Accuracy: 0.672000 Epoch 57, CIFAR-10 Batch 4: Loss: 0.6402 Validation Accuracy: 0.650600 Epoch 57, CIFAR-10 Batch 5: Loss: 0.5175 Validation Accuracy: 0.532800 Epoch 58, CIFAR-10 Batch 1: Loss: 0.6326 Validation Accuracy: 0.606200 Epoch 58, CIFAR-10 Batch 2: Loss: 0.7374 Validation Accuracy: 0.549000 Epoch 58, CIFAR-10 Batch 3: Loss: 0.8981 Validation Accuracy: 0.601400 Epoch 58, CIFAR-10 Batch 4: Loss: 0.6436 Validation Accuracy: 0.605200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.5069 Validation Accuracy: 0.568200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.6300 Validation Accuracy: 0.484200 Epoch 59, CIFAR-10 Batch 2: Loss: 0.7076 Validation Accuracy: 0.415200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.8349 Validation Accuracy: 0.654600 Epoch 59, CIFAR-10 Batch 4: Loss: 0.6486 Validation Accuracy: 0.671400 Epoch 59, CIFAR-10 Batch 5: Loss: 0.4930 Validation Accuracy: 0.672800 Epoch 60, CIFAR-10 Batch 1: Loss: 0.5966 Validation Accuracy: 0.636400 Epoch 60, CIFAR-10 Batch 2: Loss: 0.7406 Validation Accuracy: 0.593000 Epoch 60, CIFAR-10 Batch 3: Loss: 0.8650 Validation Accuracy: 0.612800 Epoch 60, CIFAR-10 Batch 4: Loss: 0.6591 Validation Accuracy: 0.534800 Epoch 60, CIFAR-10 Batch 5: Loss: 0.5160 Validation Accuracy: 0.612600 Epoch 61, CIFAR-10 Batch 1: Loss: 0.6152 Validation Accuracy: 0.604800 Epoch 61, CIFAR-10 Batch 2: Loss: 0.7470 Validation Accuracy: 0.537400 Epoch 61, CIFAR-10 Batch 3: Loss: 0.8785 Validation Accuracy: 0.573400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.6543 Validation Accuracy: 0.649400 Epoch 61, CIFAR-10 Batch 5: Loss: 0.4889 Validation Accuracy: 0.637800 Epoch 62, CIFAR-10 Batch 1: Loss: 0.6430 Validation Accuracy: 0.629200 Epoch 62, CIFAR-10 Batch 2: Loss: 0.7635 Validation Accuracy: 0.647800 Epoch 62, CIFAR-10 Batch 3: Loss: 0.8439 Validation Accuracy: 0.661400 Epoch 62, CIFAR-10 Batch 4: Loss: 0.6494 Validation Accuracy: 0.460200 Epoch 62, CIFAR-10 Batch 5: Loss: 0.5316 Validation Accuracy: 0.565800 Epoch 63, CIFAR-10 Batch 1: Loss: 0.5992 Validation Accuracy: 0.605600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.7355 Validation Accuracy: 0.661600 Epoch 63, CIFAR-10 Batch 3: Loss: 0.8219 Validation Accuracy: 0.640400 Epoch 63, CIFAR-10 Batch 4: Loss: 0.6727 Validation Accuracy: 0.625400 Epoch 63, CIFAR-10 Batch 5: Loss: 0.5608 Validation Accuracy: 0.606000 Epoch 64, CIFAR-10 Batch 1: Loss: 0.6508 Validation Accuracy: 0.669200 Epoch 64, CIFAR-10 Batch 2: Loss: 0.7481 Validation Accuracy: 0.676000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.8904 Validation Accuracy: 0.638400 Epoch 64, CIFAR-10 Batch 4: Loss: 0.6374 Validation Accuracy: 0.355800 Epoch 64, CIFAR-10 Batch 5: Loss: 0.5173 Validation Accuracy: 0.536400 Epoch 65, CIFAR-10 Batch 1: Loss: 0.6057 Validation Accuracy: 0.638600 Epoch 65, CIFAR-10 Batch 2: Loss: 0.7085 Validation Accuracy: 0.643400 Epoch 65, CIFAR-10 Batch 3: Loss: 0.9061 Validation Accuracy: 0.654800 Epoch 65, CIFAR-10 Batch 4: Loss: 0.6594 Validation Accuracy: 0.629400 Epoch 65, CIFAR-10 Batch 5: Loss: 0.5118 Validation Accuracy: 0.521200 Epoch 66, CIFAR-10 Batch 1: Loss: 0.6015 Validation Accuracy: 0.563000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.7339 Validation Accuracy: 0.662400 Epoch 66, CIFAR-10 Batch 3: Loss: 0.8398 Validation Accuracy: 0.632400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.6630 Validation Accuracy: 0.505200 Epoch 66, CIFAR-10 Batch 5: Loss: 0.4934 Validation Accuracy: 0.397200 Epoch 67, CIFAR-10 Batch 1: Loss: 0.5988 Validation Accuracy: 0.627600 Epoch 67, CIFAR-10 Batch 2: Loss: 0.7310 Validation Accuracy: 0.517800 Epoch 67, CIFAR-10 Batch 3: Loss: 0.8406 Validation Accuracy: 0.635000 Epoch 67, CIFAR-10 Batch 4: Loss: 0.6140 Validation Accuracy: 0.606200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.4662 Validation Accuracy: 0.565200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.6034 Validation Accuracy: 0.678400 Epoch 68, CIFAR-10 Batch 2: Loss: 0.6962 Validation Accuracy: 0.478800 Epoch 68, CIFAR-10 Batch 3: Loss: 0.8284 Validation Accuracy: 0.565800 Epoch 68, CIFAR-10 Batch 4: Loss: 0.6475 Validation Accuracy: 0.554400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.4939 Validation Accuracy: 0.558000 Epoch 69, CIFAR-10 Batch 1: Loss: 0.5866 Validation Accuracy: 0.539200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.7606 Validation Accuracy: 0.634800 Epoch 69, CIFAR-10 Batch 3: Loss: 0.8373 Validation Accuracy: 0.641400 Epoch 69, CIFAR-10 Batch 4: Loss: 0.6334 Validation Accuracy: 0.626000 Epoch 69, CIFAR-10 Batch 5: Loss: 0.5031 Validation Accuracy: 0.585800 Epoch 70, CIFAR-10 Batch 1: Loss: 0.5816 Validation Accuracy: 0.653800 Epoch 70, CIFAR-10 Batch 2: Loss: 0.7634 Validation Accuracy: 0.662200 Epoch 70, CIFAR-10 Batch 3: Loss: 0.8080 Validation Accuracy: 0.639400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.6403 Validation Accuracy: 0.587400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.5094 Validation Accuracy: 0.573000 Epoch 71, CIFAR-10 Batch 1: Loss: 0.5771 Validation Accuracy: 0.578400 Epoch 71, CIFAR-10 Batch 2: Loss: 0.7410 Validation Accuracy: 0.551000 Epoch 71, CIFAR-10 Batch 3: Loss: 0.7968 Validation Accuracy: 0.571000 Epoch 71, CIFAR-10 Batch 4: Loss: 0.6445 Validation Accuracy: 0.529600 Epoch 71, CIFAR-10 Batch 5: Loss: 0.4860 Validation Accuracy: 0.658600 Epoch 72, CIFAR-10 Batch 1: Loss: 0.5821 Validation Accuracy: 0.582200 Epoch 72, CIFAR-10 Batch 2: Loss: 0.6937 Validation Accuracy: 0.480600 Epoch 72, CIFAR-10 Batch 3: Loss: 0.8173 Validation Accuracy: 0.666400 Epoch 72, CIFAR-10 Batch 4: Loss: 0.6166 Validation Accuracy: 0.650600 Epoch 72, CIFAR-10 Batch 5: Loss: 0.5699 Validation Accuracy: 0.630600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.5639 Validation Accuracy: 0.667400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.6963 Validation Accuracy: 0.670000 Epoch 73, CIFAR-10 Batch 3: Loss: 0.8437 Validation Accuracy: 0.665000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.6134 Validation Accuracy: 0.660200 Epoch 73, CIFAR-10 Batch 5: Loss: 0.4837 Validation Accuracy: 0.634400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.6140 Validation Accuracy: 0.613600 Epoch 74, CIFAR-10 Batch 2: Loss: 0.7739 Validation Accuracy: 0.529400 Epoch 74, CIFAR-10 Batch 3: Loss: 0.8216 Validation Accuracy: 0.653600 Epoch 74, CIFAR-10 Batch 4: Loss: 0.6375 Validation Accuracy: 0.514600 Epoch 74, CIFAR-10 Batch 5: Loss: 0.4822 Validation Accuracy: 0.414200 Epoch 75, CIFAR-10 Batch 1: Loss: 0.5779 Validation Accuracy: 0.613600 Epoch 75, CIFAR-10 Batch 2: Loss: 0.7092 Validation Accuracy: 0.617400 Epoch 75, CIFAR-10 Batch 3: Loss: 0.8224 Validation Accuracy: 0.672600 Epoch 75, CIFAR-10 Batch 4: Loss: 0.6215 Validation Accuracy: 0.639200 Epoch 75, CIFAR-10 Batch 5: Loss: 0.4862 Validation Accuracy: 0.628600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.5725 Validation Accuracy: 0.703600 Epoch 76, CIFAR-10 Batch 2: Loss: 0.7126 Validation Accuracy: 0.586600 Epoch 76, CIFAR-10 Batch 3: Loss: 0.8348 Validation Accuracy: 0.599000 Epoch 76, CIFAR-10 Batch 4: Loss: 0.6461 Validation Accuracy: 0.635200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.5133 Validation Accuracy: 0.566400 Epoch 77, CIFAR-10 Batch 1: Loss: 0.5750 Validation Accuracy: 0.498600 Epoch 77, CIFAR-10 Batch 2: Loss: 0.7304 Validation Accuracy: 0.555400 Epoch 77, CIFAR-10 Batch 3: Loss: 0.8234 Validation Accuracy: 0.660000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.5951 Validation Accuracy: 0.440800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.5241 Validation Accuracy: 0.607800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.6045 Validation Accuracy: 0.645000 Epoch 78, CIFAR-10 Batch 2: Loss: 0.7187 Validation Accuracy: 0.570000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.8659 Validation Accuracy: 0.600200 Epoch 78, CIFAR-10 Batch 4: Loss: 0.6078 Validation Accuracy: 0.607000 Epoch 78, CIFAR-10 Batch 5: Loss: 0.5050 Validation Accuracy: 0.552600 Epoch 79, CIFAR-10 Batch 1: Loss: 0.6206 Validation Accuracy: 0.714400 Epoch 79, CIFAR-10 Batch 2: Loss: 0.7130 Validation Accuracy: 0.497600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.8001 Validation Accuracy: 0.602600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.5917 Validation Accuracy: 0.656200 Epoch 79, CIFAR-10 Batch 5: Loss: 0.5021 Validation Accuracy: 0.447800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.6097 Validation Accuracy: 0.581800 Epoch 80, CIFAR-10 Batch 2: Loss: 0.6977 Validation Accuracy: 0.571600 Epoch 80, CIFAR-10 Batch 3: Loss: 0.8130 Validation Accuracy: 0.636600 Epoch 80, CIFAR-10 Batch 4: Loss: 0.6683 Validation Accuracy: 0.608800 Epoch 80, CIFAR-10 Batch 5: Loss: 0.5204 Validation Accuracy: 0.647000 Epoch 81, CIFAR-10 Batch 1: Loss: 0.6316 Validation Accuracy: 0.612000 Epoch 81, CIFAR-10 Batch 2: Loss: 0.7359 Validation Accuracy: 0.524600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.8872 Validation Accuracy: 0.561200 Epoch 81, CIFAR-10 Batch 4: Loss: 0.6225 Validation Accuracy: 0.618800 Epoch 81, CIFAR-10 Batch 5: Loss: 0.4998 Validation Accuracy: 0.532800 Epoch 82, CIFAR-10 Batch 1: Loss: 0.5784 Validation Accuracy: 0.731000 Epoch 82, CIFAR-10 Batch 2: Loss: 0.7018 Validation Accuracy: 0.754000 Epoch 82, CIFAR-10 Batch 3: Loss: 0.7632 Validation Accuracy: 0.768600 Epoch 82, CIFAR-10 Batch 4: Loss: 0.5355 Validation Accuracy: 0.762000 Epoch 82, CIFAR-10 Batch 5: Loss: 0.4226 Validation Accuracy: 0.767000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.5188 Validation Accuracy: 0.771400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.6457 Validation Accuracy: 0.772600 Epoch 83, CIFAR-10 Batch 3: Loss: 0.7306 Validation Accuracy: 0.774200 Epoch 83, CIFAR-10 Batch 4: Loss: 0.5171 Validation Accuracy: 0.772200 Epoch 83, CIFAR-10 Batch 5: Loss: 0.4121 Validation Accuracy: 0.773400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.5181 Validation Accuracy: 0.773600 Epoch 84, CIFAR-10 Batch 2: Loss: 0.6389 Validation Accuracy: 0.773800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.7243 Validation Accuracy: 0.774200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.5118 Validation Accuracy: 0.775200 Epoch 84, CIFAR-10 Batch 5: Loss: 0.4114 Validation Accuracy: 0.776000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.5176 Validation Accuracy: 0.774800 Epoch 85, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774200 Epoch 85, CIFAR-10 Batch 3: Loss: 0.7240 Validation Accuracy: 0.774200 Epoch 85, CIFAR-10 Batch 4: Loss: 0.5114 Validation Accuracy: 0.774800 Epoch 85, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.5176 Validation Accuracy: 0.774400 Epoch 86, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774600 Epoch 86, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.773800 Epoch 86, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 86, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 87, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 87, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 87, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 87, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 88, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 88, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 88, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 88, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 89, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 89, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 89, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 90, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 90, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 90, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 91, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774400 Epoch 91, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 92, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 92, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.773600 Epoch 92, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 92, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 93, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 94, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 94, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 94, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 94, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 94, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 95, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 95, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 95, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.775000 Epoch 96, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 96, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 96, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 96, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 97, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 97, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 97, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 97, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 98, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 98, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 98, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 98, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 98, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 99, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 99, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 99, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 100, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 100, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 100, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775200 Epoch 100, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 101, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 101, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 101, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 101, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 102, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 102, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 102, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 102, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 102, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 103, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 103, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 103, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 103, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 103, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 104, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 104, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 104, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 105, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 105, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 106, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 106, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 106, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 106, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 106, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 107, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 107, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 107, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 108, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 108, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 108, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 108, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 108, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 109, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 109, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 109, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 109, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 110, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 110, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 110, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 110, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 111, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 111, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 111, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 112, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 112, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 112, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 112, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 112, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775400 Epoch 113, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 113, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 113, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 113, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 114, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 114, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 114, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 114, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 115, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 115, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775400 Epoch 115, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 115, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 115, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 116, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 116, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 116, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 116, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 116, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 117, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 117, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 117, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 118, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 118, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 118, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 118, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 118, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 119, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 119, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 119, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 120, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 120, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 120, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 120, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 120, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774600 Epoch 121, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 121, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 121, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 122, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 122, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 122, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 123, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 123, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 123, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 123, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.775000 Epoch 124, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 124, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 124, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 124, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774400 Epoch 125, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 125, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 125, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 125, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 126, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.775000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 126, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 126, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 126, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 127, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 127, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 127, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 128, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 128, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 128, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 128, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 128, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 129, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 129, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 129, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 129, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 130, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 130, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 130, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 130, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 131, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.775000 Epoch 131, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 131, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 132, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 132, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 132, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 132, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 132, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 133, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 133, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 133, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 133, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 134, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 134, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 134, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 134, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 134, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 135, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 135, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 135, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.773800 Epoch 135, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 135, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 136, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 136, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 136, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 136, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 137, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 137, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 137, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 138, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 138, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 138, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 138, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 138, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 139, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 139, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 139, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 139, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 140, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 140, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 140, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 140, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 141, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 141, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 141, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 141, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 142, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 142, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 142, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 142, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 143, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 143, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 143, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 143, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 143, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 144, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 144, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 144, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 144, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 145, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 145, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 145, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 145, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 145, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 146, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 146, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 146, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 146, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 147, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774600 Epoch 147, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 147, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 147, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 148, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 148, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 148, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 148, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774400 Epoch 149, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 149, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 150, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 150, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774400 Epoch 150, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774000 Epoch 150, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 150, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 151, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 151, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 151, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 151, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 152, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 152, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 152, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 152, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 152, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.775000 Epoch 153, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 153, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 153, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 153, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 154, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 154, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 154, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 155, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774800 Epoch 155, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 155, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 156, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 156, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 156, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 156, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 156, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 157, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 157, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 157, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 157, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 158, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 158, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 158, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 158, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 158, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 159, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 159, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774400 Epoch 159, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 159, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 160, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775000 Epoch 160, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 160, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 160, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774400 Epoch 161, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774600 Epoch 161, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 161, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774800 Epoch 161, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Epoch 162, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774200 Epoch 162, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.774800 Epoch 162, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774600 Epoch 162, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.774600 Epoch 162, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774600 Epoch 163, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 163, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775000 Epoch 163, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.775400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.5175 Validation Accuracy: 0.774800 Epoch 164, CIFAR-10 Batch 2: Loss: 0.6377 Validation Accuracy: 0.775200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.7239 Validation Accuracy: 0.774200 Epoch 164, CIFAR-10 Batch 4: Loss: 0.5113 Validation Accuracy: 0.775200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.4113 Validation Accuracy: 0.774800 Training for learning_rate=0.01000, batch_size=256 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.6722 Validation Accuracy: 0.111600 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6609 Validation Accuracy: 0.196600 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3863 Validation Accuracy: 0.215400 Epoch 1, CIFAR-10 Batch 4: Loss: 1.2470 Validation Accuracy: 0.264600 Epoch 1, CIFAR-10 Batch 5: Loss: 1.0758 Validation Accuracy: 0.275800 Epoch 2, CIFAR-10 Batch 1: Loss: 0.8232 Validation Accuracy: 0.214600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.1521 Validation Accuracy: 0.410600 Epoch 2, CIFAR-10 Batch 3: Loss: 0.7904 Validation Accuracy: 0.449400 Epoch 2, CIFAR-10 Batch 4: Loss: 0.7859 Validation Accuracy: 0.401600 Epoch 2, CIFAR-10 Batch 5: Loss: 0.8501 Validation Accuracy: 0.303400 Epoch 3, CIFAR-10 Batch 1: Loss: 0.6515 Validation Accuracy: 0.364400 Epoch 3, CIFAR-10 Batch 2: Loss: 0.8452 Validation Accuracy: 0.316600 Epoch 3, CIFAR-10 Batch 3: Loss: 0.6587 Validation Accuracy: 0.548000 Epoch 3, CIFAR-10 Batch 4: Loss: 0.6555 Validation Accuracy: 0.325200 Epoch 3, CIFAR-10 Batch 5: Loss: 0.5447 Validation Accuracy: 0.522400 Epoch 4, CIFAR-10 Batch 1: Loss: 0.5668 Validation Accuracy: 0.521600 Epoch 4, CIFAR-10 Batch 2: Loss: 0.6596 Validation Accuracy: 0.491000 Epoch 4, CIFAR-10 Batch 3: Loss: 0.5378 Validation Accuracy: 0.552200 Epoch 4, CIFAR-10 Batch 4: Loss: 0.5247 Validation Accuracy: 0.553800 Epoch 4, CIFAR-10 Batch 5: Loss: 0.4397 Validation Accuracy: 0.569600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.4562 Validation Accuracy: 0.424400 Epoch 5, CIFAR-10 Batch 2: Loss: 0.4916 Validation Accuracy: 0.510200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.4937 Validation Accuracy: 0.596400 Epoch 5, CIFAR-10 Batch 4: Loss: 0.5234 Validation Accuracy: 0.659200 Epoch 5, CIFAR-10 Batch 5: Loss: 0.4063 Validation Accuracy: 0.630600 Epoch 6, CIFAR-10 Batch 1: Loss: 0.4232 Validation Accuracy: 0.707800 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4730 Validation Accuracy: 0.431800 Epoch 6, CIFAR-10 Batch 3: Loss: 0.4258 Validation Accuracy: 0.568600 Epoch 6, CIFAR-10 Batch 4: Loss: 0.4502 Validation Accuracy: 0.630400 Epoch 6, CIFAR-10 Batch 5: Loss: 0.3844 Validation Accuracy: 0.638600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.3480 Validation Accuracy: 0.688400 Epoch 7, CIFAR-10 Batch 2: Loss: 0.4156 Validation Accuracy: 0.575800 Epoch 7, CIFAR-10 Batch 3: Loss: 0.3950 Validation Accuracy: 0.718200 Epoch 7, CIFAR-10 Batch 4: Loss: 0.3931 Validation Accuracy: 0.617800 Epoch 7, CIFAR-10 Batch 5: Loss: 0.3336 Validation Accuracy: 0.621000 Epoch 8, CIFAR-10 Batch 1: Loss: 0.3451 Validation Accuracy: 0.532000 Epoch 8, CIFAR-10 Batch 2: Loss: 0.3541 Validation Accuracy: 0.679600 Epoch 8, CIFAR-10 Batch 3: Loss: 0.3691 Validation Accuracy: 0.619200 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3873 Validation Accuracy: 0.620000 Epoch 8, CIFAR-10 Batch 5: Loss: 0.3419 Validation Accuracy: 0.686400 Epoch 9, CIFAR-10 Batch 1: Loss: 0.2857 Validation Accuracy: 0.631800 Epoch 9, CIFAR-10 Batch 2: Loss: 0.3314 Validation Accuracy: 0.742000 Epoch 9, CIFAR-10 Batch 3: Loss: 0.3405 Validation Accuracy: 0.611000 Epoch 9, CIFAR-10 Batch 4: Loss: 0.3350 Validation Accuracy: 0.659600 Epoch 9, CIFAR-10 Batch 5: Loss: 0.2648 Validation Accuracy: 0.725400 Epoch 10, CIFAR-10 Batch 1: Loss: 0.2638 Validation Accuracy: 0.745800 Epoch 10, CIFAR-10 Batch 2: Loss: 0.3060 Validation Accuracy: 0.700200 Epoch 10, CIFAR-10 Batch 3: Loss: 0.3350 Validation Accuracy: 0.732200 Epoch 10, CIFAR-10 Batch 4: Loss: 0.3278 Validation Accuracy: 0.737000 Epoch 10, CIFAR-10 Batch 5: Loss: 0.2766 Validation Accuracy: 0.672400 Epoch 11, CIFAR-10 Batch 1: Loss: 0.2531 Validation Accuracy: 0.720000 Epoch 11, CIFAR-10 Batch 2: Loss: 0.2733 Validation Accuracy: 0.710400 Epoch 11, CIFAR-10 Batch 3: Loss: 0.2731 Validation Accuracy: 0.696600 Epoch 11, CIFAR-10 Batch 4: Loss: 0.2901 Validation Accuracy: 0.720800 Epoch 11, CIFAR-10 Batch 5: Loss: 0.2742 Validation Accuracy: 0.493800 Epoch 12, CIFAR-10 Batch 1: Loss: 0.2525 Validation Accuracy: 0.734800 Epoch 12, CIFAR-10 Batch 2: Loss: 0.2524 Validation Accuracy: 0.734800 Epoch 12, CIFAR-10 Batch 3: Loss: 0.2915 Validation Accuracy: 0.671000 Epoch 12, CIFAR-10 Batch 4: Loss: 0.2593 Validation Accuracy: 0.746400 Epoch 12, CIFAR-10 Batch 5: Loss: 0.2437 Validation Accuracy: 0.713400 Epoch 13, CIFAR-10 Batch 1: Loss: 0.2209 Validation Accuracy: 0.711600 Epoch 13, CIFAR-10 Batch 2: Loss: 0.2415 Validation Accuracy: 0.594000 Epoch 13, CIFAR-10 Batch 3: Loss: 0.3020 Validation Accuracy: 0.710600 Epoch 13, CIFAR-10 Batch 4: Loss: 0.2547 Validation Accuracy: 0.711800 Epoch 13, CIFAR-10 Batch 5: Loss: 0.2272 Validation Accuracy: 0.751000 Epoch 14, CIFAR-10 Batch 1: Loss: 0.2298 Validation Accuracy: 0.786400 Epoch 14, CIFAR-10 Batch 2: Loss: 0.2283 Validation Accuracy: 0.682800 Epoch 14, CIFAR-10 Batch 3: Loss: 0.2660 Validation Accuracy: 0.788600 Epoch 14, CIFAR-10 Batch 4: Loss: 0.2602 Validation Accuracy: 0.770000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.1960 Validation Accuracy: 0.734200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.2035 Validation Accuracy: 0.728400 Epoch 15, CIFAR-10 Batch 2: Loss: 0.2321 Validation Accuracy: 0.732400 Epoch 15, CIFAR-10 Batch 3: Loss: 0.2806 Validation Accuracy: 0.736000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.2301 Validation Accuracy: 0.775800 Epoch 15, CIFAR-10 Batch 5: Loss: 0.2262 Validation Accuracy: 0.776600 Epoch 16, CIFAR-10 Batch 1: Loss: 0.1952 Validation Accuracy: 0.735200 Epoch 16, CIFAR-10 Batch 2: Loss: 0.2043 Validation Accuracy: 0.716400 Epoch 16, CIFAR-10 Batch 3: Loss: 0.2538 Validation Accuracy: 0.714400 Epoch 16, CIFAR-10 Batch 4: Loss: 0.2239 Validation Accuracy: 0.749400 Epoch 16, CIFAR-10 Batch 5: Loss: 0.2069 Validation Accuracy: 0.752600 Epoch 17, CIFAR-10 Batch 1: Loss: 0.1945 Validation Accuracy: 0.756800 Epoch 17, CIFAR-10 Batch 2: Loss: 0.2458 Validation Accuracy: 0.744600 Epoch 17, CIFAR-10 Batch 3: Loss: 0.2062 Validation Accuracy: 0.751600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.2194 Validation Accuracy: 0.716400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.1864 Validation Accuracy: 0.736000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.2012 Validation Accuracy: 0.742600 Epoch 18, CIFAR-10 Batch 2: Loss: 0.1976 Validation Accuracy: 0.726400 Epoch 18, CIFAR-10 Batch 3: Loss: 0.2263 Validation Accuracy: 0.764000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.2025 Validation Accuracy: 0.795800 Epoch 18, CIFAR-10 Batch 5: Loss: 0.1826 Validation Accuracy: 0.765000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.1878 Validation Accuracy: 0.796400 Epoch 19, CIFAR-10 Batch 2: Loss: 0.1968 Validation Accuracy: 0.784600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.2023 Validation Accuracy: 0.663400 Epoch 19, CIFAR-10 Batch 4: Loss: 0.1925 Validation Accuracy: 0.750200 Epoch 19, CIFAR-10 Batch 5: Loss: 0.1821 Validation Accuracy: 0.801400 Epoch 20, CIFAR-10 Batch 1: Loss: 0.1827 Validation Accuracy: 0.793000 Epoch 20, CIFAR-10 Batch 2: Loss: 0.1937 Validation Accuracy: 0.768200 Epoch 20, CIFAR-10 Batch 3: Loss: 0.1915 Validation Accuracy: 0.771000 Epoch 20, CIFAR-10 Batch 4: Loss: 0.2061 Validation Accuracy: 0.760200 Epoch 20, CIFAR-10 Batch 5: Loss: 0.1787 Validation Accuracy: 0.787200 Epoch 21, CIFAR-10 Batch 1: Loss: 0.1745 Validation Accuracy: 0.811200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.1965 Validation Accuracy: 0.811800 Epoch 21, CIFAR-10 Batch 3: Loss: 0.1836 Validation Accuracy: 0.738000 Epoch 21, CIFAR-10 Batch 4: Loss: 0.1907 Validation Accuracy: 0.673000 Epoch 21, CIFAR-10 Batch 5: Loss: 0.1778 Validation Accuracy: 0.725400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.1760 Validation Accuracy: 0.564000 Epoch 22, CIFAR-10 Batch 2: Loss: 0.2092 Validation Accuracy: 0.719200 Epoch 22, CIFAR-10 Batch 3: Loss: 0.1827 Validation Accuracy: 0.623600 Epoch 22, CIFAR-10 Batch 4: Loss: 0.1880 Validation Accuracy: 0.739600 Epoch 22, CIFAR-10 Batch 5: Loss: 0.1862 Validation Accuracy: 0.743000 Epoch 23, CIFAR-10 Batch 1: Loss: 0.1758 Validation Accuracy: 0.788800 Epoch 23, CIFAR-10 Batch 2: Loss: 0.1897 Validation Accuracy: 0.774400 Epoch 23, CIFAR-10 Batch 3: Loss: 0.1956 Validation Accuracy: 0.730800 Epoch 23, CIFAR-10 Batch 4: Loss: 0.1844 Validation Accuracy: 0.753000 Epoch 23, CIFAR-10 Batch 5: Loss: 0.1698 Validation Accuracy: 0.785600 Epoch 24, CIFAR-10 Batch 1: Loss: 0.1678 Validation Accuracy: 0.755200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.1983 Validation Accuracy: 0.797600 Epoch 24, CIFAR-10 Batch 3: Loss: 0.1801 Validation Accuracy: 0.758400 Epoch 24, CIFAR-10 Batch 4: Loss: 0.1809 Validation Accuracy: 0.796400 Epoch 24, CIFAR-10 Batch 5: Loss: 0.1707 Validation Accuracy: 0.707200 Epoch 25, CIFAR-10 Batch 1: Loss: 0.1713 Validation Accuracy: 0.758400 Epoch 25, CIFAR-10 Batch 2: Loss: 0.1877 Validation Accuracy: 0.766000 Epoch 25, CIFAR-10 Batch 3: Loss: 0.1854 Validation Accuracy: 0.779400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.1848 Validation Accuracy: 0.738000 Epoch 25, CIFAR-10 Batch 5: Loss: 0.1697 Validation Accuracy: 0.765400 Epoch 26, CIFAR-10 Batch 1: Loss: 0.1716 Validation Accuracy: 0.708800 Epoch 26, CIFAR-10 Batch 2: Loss: 0.1923 Validation Accuracy: 0.788800 Epoch 26, CIFAR-10 Batch 3: Loss: 0.1854 Validation Accuracy: 0.760000 Epoch 26, CIFAR-10 Batch 4: Loss: 0.1803 Validation Accuracy: 0.787200 Epoch 26, CIFAR-10 Batch 5: Loss: 0.1692 Validation Accuracy: 0.832800 Epoch 27, CIFAR-10 Batch 1: Loss: 0.1648 Validation Accuracy: 0.756600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.1798 Validation Accuracy: 0.784200 Epoch 27, CIFAR-10 Batch 3: Loss: 0.1772 Validation Accuracy: 0.784000 Epoch 27, CIFAR-10 Batch 4: Loss: 0.1817 Validation Accuracy: 0.800000 Epoch 27, CIFAR-10 Batch 5: Loss: 0.1660 Validation Accuracy: 0.717600 Epoch 28, CIFAR-10 Batch 1: Loss: 0.1589 Validation Accuracy: 0.740000 Epoch 28, CIFAR-10 Batch 2: Loss: 0.1756 Validation Accuracy: 0.726200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.1702 Validation Accuracy: 0.799400 Epoch 28, CIFAR-10 Batch 4: Loss: 0.1749 Validation Accuracy: 0.762400 Epoch 28, CIFAR-10 Batch 5: Loss: 0.1674 Validation Accuracy: 0.799000 Epoch 29, CIFAR-10 Batch 1: Loss: 0.1677 Validation Accuracy: 0.769200 Epoch 29, CIFAR-10 Batch 2: Loss: 0.1802 Validation Accuracy: 0.742600 Epoch 29, CIFAR-10 Batch 3: Loss: 0.1764 Validation Accuracy: 0.748400 Epoch 29, CIFAR-10 Batch 4: Loss: 0.1722 Validation Accuracy: 0.752000 Epoch 29, CIFAR-10 Batch 5: Loss: 0.1704 Validation Accuracy: 0.761600 Epoch 30, CIFAR-10 Batch 1: Loss: 0.1610 Validation Accuracy: 0.751000 Epoch 30, CIFAR-10 Batch 2: Loss: 0.1753 Validation Accuracy: 0.714800 Epoch 30, CIFAR-10 Batch 3: Loss: 0.1699 Validation Accuracy: 0.823600 Epoch 30, CIFAR-10 Batch 4: Loss: 0.1749 Validation Accuracy: 0.742600 Epoch 30, CIFAR-10 Batch 5: Loss: 0.1648 Validation Accuracy: 0.754000 Epoch 31, CIFAR-10 Batch 1: Loss: 0.1625 Validation Accuracy: 0.819600 Epoch 31, CIFAR-10 Batch 2: Loss: 0.1678 Validation Accuracy: 0.774200 Epoch 31, CIFAR-10 Batch 3: Loss: 0.1633 Validation Accuracy: 0.717800 Epoch 31, CIFAR-10 Batch 4: Loss: 0.1633 Validation Accuracy: 0.733800 Epoch 31, CIFAR-10 Batch 5: Loss: 0.1583 Validation Accuracy: 0.804000 Epoch 32, CIFAR-10 Batch 1: Loss: 0.1616 Validation Accuracy: 0.783600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.1663 Validation Accuracy: 0.720600 Epoch 32, CIFAR-10 Batch 3: Loss: 0.1605 Validation Accuracy: 0.747800 Epoch 32, CIFAR-10 Batch 4: Loss: 0.1609 Validation Accuracy: 0.809000 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1572 Validation Accuracy: 0.824400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.1566 Validation Accuracy: 0.812600 Epoch 33, CIFAR-10 Batch 2: Loss: 0.1640 Validation Accuracy: 0.789200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.1754 Validation Accuracy: 0.777600 Epoch 33, CIFAR-10 Batch 4: Loss: 0.1632 Validation Accuracy: 0.748200 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1580 Validation Accuracy: 0.809200 Epoch 34, CIFAR-10 Batch 1: Loss: 0.1577 Validation Accuracy: 0.760800 Epoch 34, CIFAR-10 Batch 2: Loss: 0.1663 Validation Accuracy: 0.740200 Epoch 34, CIFAR-10 Batch 3: Loss: 0.1679 Validation Accuracy: 0.761000 Epoch 34, CIFAR-10 Batch 4: Loss: 0.1708 Validation Accuracy: 0.808200 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1628 Validation Accuracy: 0.782600 Epoch 35, CIFAR-10 Batch 1: Loss: 0.1654 Validation Accuracy: 0.719200 Epoch 35, CIFAR-10 Batch 2: Loss: 0.1671 Validation Accuracy: 0.792200 Epoch 35, CIFAR-10 Batch 3: Loss: 0.1634 Validation Accuracy: 0.786200 Epoch 35, CIFAR-10 Batch 4: Loss: 0.1621 Validation Accuracy: 0.778600 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1562 Validation Accuracy: 0.788800 Epoch 36, CIFAR-10 Batch 1: Loss: 0.1605 Validation Accuracy: 0.757400 Epoch 36, CIFAR-10 Batch 2: Loss: 0.1708 Validation Accuracy: 0.793200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.1794 Validation Accuracy: 0.749400 Epoch 36, CIFAR-10 Batch 4: Loss: 0.1624 Validation Accuracy: 0.807200 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1547 Validation Accuracy: 0.696200 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1666 Validation Accuracy: 0.740000 Epoch 37, CIFAR-10 Batch 2: Loss: 0.1718 Validation Accuracy: 0.774200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.1658 Validation Accuracy: 0.613400 Epoch 37, CIFAR-10 Batch 4: Loss: 0.1664 Validation Accuracy: 0.839800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1627 Validation Accuracy: 0.772200 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1599 Validation Accuracy: 0.791600 Epoch 38, CIFAR-10 Batch 2: Loss: 0.1679 Validation Accuracy: 0.710800 Epoch 38, CIFAR-10 Batch 3: Loss: 0.1666 Validation Accuracy: 0.730000 Epoch 38, CIFAR-10 Batch 4: Loss: 0.1617 Validation Accuracy: 0.713800 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1568 Validation Accuracy: 0.787400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1547 Validation Accuracy: 0.752000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.1578 Validation Accuracy: 0.747600 Epoch 39, CIFAR-10 Batch 3: Loss: 0.1607 Validation Accuracy: 0.704400 Epoch 39, CIFAR-10 Batch 4: Loss: 0.1598 Validation Accuracy: 0.812400 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1545 Validation Accuracy: 0.750600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1577 Validation Accuracy: 0.792600 Epoch 40, CIFAR-10 Batch 2: Loss: 0.1600 Validation Accuracy: 0.807200 Epoch 40, CIFAR-10 Batch 3: Loss: 0.1593 Validation Accuracy: 0.702400 Epoch 40, CIFAR-10 Batch 4: Loss: 0.1619 Validation Accuracy: 0.833600 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1570 Validation Accuracy: 0.772200 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1584 Validation Accuracy: 0.763400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1612 Validation Accuracy: 0.727200 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1571 Validation Accuracy: 0.827400 Epoch 41, CIFAR-10 Batch 4: Loss: 0.1568 Validation Accuracy: 0.847400 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1533 Validation Accuracy: 0.803200 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1523 Validation Accuracy: 0.815600 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1607 Validation Accuracy: 0.800600 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1577 Validation Accuracy: 0.756600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.1631 Validation Accuracy: 0.826600 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1560 Validation Accuracy: 0.824200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1636 Validation Accuracy: 0.703600 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1633 Validation Accuracy: 0.783800 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1623 Validation Accuracy: 0.828200 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1574 Validation Accuracy: 0.829000 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1538 Validation Accuracy: 0.772000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1669 Validation Accuracy: 0.770200 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1623 Validation Accuracy: 0.784600 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1668 Validation Accuracy: 0.816000 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1602 Validation Accuracy: 0.775600 Epoch 44, CIFAR-10 Batch 5: Loss: 0.1545 Validation Accuracy: 0.821600 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1536 Validation Accuracy: 0.778200 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1620 Validation Accuracy: 0.617000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1572 Validation Accuracy: 0.808200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1585 Validation Accuracy: 0.798800 Epoch 45, CIFAR-10 Batch 5: Loss: 0.1547 Validation Accuracy: 0.832200 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1523 Validation Accuracy: 0.791800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1560 Validation Accuracy: 0.794400 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1549 Validation Accuracy: 0.832800 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1580 Validation Accuracy: 0.810800 Epoch 46, CIFAR-10 Batch 5: Loss: 0.1533 Validation Accuracy: 0.808200 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1552 Validation Accuracy: 0.799000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1568 Validation Accuracy: 0.800600 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1576 Validation Accuracy: 0.787000 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1698 Validation Accuracy: 0.774600 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1578 Validation Accuracy: 0.777800 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1584 Validation Accuracy: 0.830200 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1651 Validation Accuracy: 0.821600 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1587 Validation Accuracy: 0.764800 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1575 Validation Accuracy: 0.808200 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1537 Validation Accuracy: 0.777800 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1527 Validation Accuracy: 0.828800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1578 Validation Accuracy: 0.782400 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1545 Validation Accuracy: 0.833400 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1577 Validation Accuracy: 0.815600 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1550 Validation Accuracy: 0.829800 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1547 Validation Accuracy: 0.732400 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1553 Validation Accuracy: 0.802600 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1526 Validation Accuracy: 0.720000 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1538 Validation Accuracy: 0.803600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.1510 Validation Accuracy: 0.795600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1510 Validation Accuracy: 0.754800 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1540 Validation Accuracy: 0.837000 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1583 Validation Accuracy: 0.764000 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1587 Validation Accuracy: 0.816000 Epoch 51, CIFAR-10 Batch 5: Loss: 0.1540 Validation Accuracy: 0.812400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1532 Validation Accuracy: 0.782400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1641 Validation Accuracy: 0.736400 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1589 Validation Accuracy: 0.755000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1601 Validation Accuracy: 0.804600 Epoch 52, CIFAR-10 Batch 5: Loss: 0.1569 Validation Accuracy: 0.741200 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1557 Validation Accuracy: 0.781400 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1549 Validation Accuracy: 0.813800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1596 Validation Accuracy: 0.723400 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1594 Validation Accuracy: 0.824200 Epoch 53, CIFAR-10 Batch 5: Loss: 0.1553 Validation Accuracy: 0.794200 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1555 Validation Accuracy: 0.809600 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1569 Validation Accuracy: 0.809000 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1535 Validation Accuracy: 0.840800 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1549 Validation Accuracy: 0.788000 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1509 Validation Accuracy: 0.821800 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1509 Validation Accuracy: 0.766800 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1533 Validation Accuracy: 0.802800 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1525 Validation Accuracy: 0.825600 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1569 Validation Accuracy: 0.770600 Epoch 55, CIFAR-10 Batch 5: Loss: 0.1507 Validation Accuracy: 0.804200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1516 Validation Accuracy: 0.752600 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1548 Validation Accuracy: 0.688600 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1499 Validation Accuracy: 0.814400 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1538 Validation Accuracy: 0.822400 Epoch 56, CIFAR-10 Batch 5: Loss: 0.1551 Validation Accuracy: 0.796000 Epoch 57, CIFAR-10 Batch 1: Loss: 0.1498 Validation Accuracy: 0.789400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1542 Validation Accuracy: 0.755000 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1553 Validation Accuracy: 0.825200 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1568 Validation Accuracy: 0.819800 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1561 Validation Accuracy: 0.813400 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1543 Validation Accuracy: 0.794800 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1544 Validation Accuracy: 0.833200 Epoch 58, CIFAR-10 Batch 3: Loss: 0.1521 Validation Accuracy: 0.715800 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1522 Validation Accuracy: 0.818200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1489 Validation Accuracy: 0.799000 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1485 Validation Accuracy: 0.751400 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1540 Validation Accuracy: 0.740200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1520 Validation Accuracy: 0.799600 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1506 Validation Accuracy: 0.832400 Epoch 59, CIFAR-10 Batch 5: Loss: 0.1506 Validation Accuracy: 0.791800 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1524 Validation Accuracy: 0.747400 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1523 Validation Accuracy: 0.809200 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1571 Validation Accuracy: 0.805000 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1553 Validation Accuracy: 0.790400 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1568 Validation Accuracy: 0.778800 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1508 Validation Accuracy: 0.820400 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1604 Validation Accuracy: 0.824000 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1531 Validation Accuracy: 0.739600 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1542 Validation Accuracy: 0.810200 Epoch 61, CIFAR-10 Batch 5: Loss: 0.1515 Validation Accuracy: 0.803000 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1512 Validation Accuracy: 0.794800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1560 Validation Accuracy: 0.824800 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1525 Validation Accuracy: 0.810800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1497 Validation Accuracy: 0.830400 Epoch 62, CIFAR-10 Batch 5: Loss: 0.1496 Validation Accuracy: 0.775200 Epoch 63, CIFAR-10 Batch 1: Loss: 0.1497 Validation Accuracy: 0.776800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1543 Validation Accuracy: 0.791000 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1606 Validation Accuracy: 0.775000 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1554 Validation Accuracy: 0.741800 Epoch 63, CIFAR-10 Batch 5: Loss: 0.1508 Validation Accuracy: 0.823400 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1507 Validation Accuracy: 0.829200 Epoch 64, CIFAR-10 Batch 2: Loss: 0.1504 Validation Accuracy: 0.838800 Epoch 64, CIFAR-10 Batch 3: Loss: 0.1482 Validation Accuracy: 0.823200 Epoch 64, CIFAR-10 Batch 4: Loss: 0.1479 Validation Accuracy: 0.838000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.1522 Validation Accuracy: 0.830400 Epoch 65, CIFAR-10 Batch 1: Loss: 0.1484 Validation Accuracy: 0.813200 Epoch 65, CIFAR-10 Batch 2: Loss: 0.1510 Validation Accuracy: 0.817200 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1606 Validation Accuracy: 0.818200 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1526 Validation Accuracy: 0.799200 Epoch 65, CIFAR-10 Batch 5: Loss: 0.1502 Validation Accuracy: 0.849000 Epoch 66, CIFAR-10 Batch 1: Loss: 0.1491 Validation Accuracy: 0.827200 Epoch 66, CIFAR-10 Batch 2: Loss: 0.1636 Validation Accuracy: 0.846600 Epoch 66, CIFAR-10 Batch 3: Loss: 0.1487 Validation Accuracy: 0.790200 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1488 Validation Accuracy: 0.812000 Epoch 66, CIFAR-10 Batch 5: Loss: 0.1472 Validation Accuracy: 0.810800 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1484 Validation Accuracy: 0.763000 Epoch 67, CIFAR-10 Batch 2: Loss: 0.1514 Validation Accuracy: 0.821600 Epoch 67, CIFAR-10 Batch 3: Loss: 0.1533 Validation Accuracy: 0.830400 Epoch 67, CIFAR-10 Batch 4: Loss: 0.1507 Validation Accuracy: 0.764200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.1472 Validation Accuracy: 0.774400 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1471 Validation Accuracy: 0.815000 Epoch 68, CIFAR-10 Batch 2: Loss: 0.1493 Validation Accuracy: 0.811400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1473 Validation Accuracy: 0.832200 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1485 Validation Accuracy: 0.776400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.1460 Validation Accuracy: 0.821400 Epoch 69, CIFAR-10 Batch 1: Loss: 0.1464 Validation Accuracy: 0.791400 Epoch 69, CIFAR-10 Batch 2: Loss: 0.1555 Validation Accuracy: 0.749400 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1553 Validation Accuracy: 0.819600 Epoch 69, CIFAR-10 Batch 4: Loss: 0.1512 Validation Accuracy: 0.789600 Epoch 69, CIFAR-10 Batch 5: Loss: 0.1546 Validation Accuracy: 0.799000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.1546 Validation Accuracy: 0.824000 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1576 Validation Accuracy: 0.846000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1617 Validation Accuracy: 0.804800 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1501 Validation Accuracy: 0.739000 Epoch 70, CIFAR-10 Batch 5: Loss: 0.1476 Validation Accuracy: 0.846800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1461 Validation Accuracy: 0.804400 Epoch 71, CIFAR-10 Batch 2: Loss: 0.1482 Validation Accuracy: 0.812200 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1480 Validation Accuracy: 0.821200 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1476 Validation Accuracy: 0.751800 Epoch 71, CIFAR-10 Batch 5: Loss: 0.1463 Validation Accuracy: 0.774800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.1438 Validation Accuracy: 0.791400 Epoch 72, CIFAR-10 Batch 2: Loss: 0.1502 Validation Accuracy: 0.812200 Epoch 72, CIFAR-10 Batch 3: Loss: 0.1494 Validation Accuracy: 0.820200 Epoch 72, CIFAR-10 Batch 4: Loss: 0.1523 Validation Accuracy: 0.836000 Epoch 72, CIFAR-10 Batch 5: Loss: 0.1508 Validation Accuracy: 0.805800 Epoch 73, CIFAR-10 Batch 1: Loss: 0.1501 Validation Accuracy: 0.810200 Epoch 73, CIFAR-10 Batch 2: Loss: 0.1535 Validation Accuracy: 0.830800 Epoch 73, CIFAR-10 Batch 3: Loss: 0.1504 Validation Accuracy: 0.802800 Epoch 73, CIFAR-10 Batch 4: Loss: 0.1496 Validation Accuracy: 0.791200 Epoch 73, CIFAR-10 Batch 5: Loss: 0.1471 Validation Accuracy: 0.825200 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1457 Validation Accuracy: 0.814200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1520 Validation Accuracy: 0.840800 Epoch 74, CIFAR-10 Batch 3: Loss: 0.1470 Validation Accuracy: 0.777400 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1464 Validation Accuracy: 0.774000 Epoch 74, CIFAR-10 Batch 5: Loss: 0.1458 Validation Accuracy: 0.824000 Epoch 75, CIFAR-10 Batch 1: Loss: 0.1476 Validation Accuracy: 0.776000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1539 Validation Accuracy: 0.818600 Epoch 75, CIFAR-10 Batch 3: Loss: 0.1474 Validation Accuracy: 0.836600 Epoch 75, CIFAR-10 Batch 4: Loss: 0.1490 Validation Accuracy: 0.843400 Epoch 75, CIFAR-10 Batch 5: Loss: 0.1453 Validation Accuracy: 0.839200 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1563 Validation Accuracy: 0.814800 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1456 Validation Accuracy: 0.796600 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.853000 Epoch 76, CIFAR-10 Batch 4: Loss: 0.1474 Validation Accuracy: 0.844600 Epoch 76, CIFAR-10 Batch 5: Loss: 0.1435 Validation Accuracy: 0.825200 Epoch 77, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.821000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.1470 Validation Accuracy: 0.847000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.1504 Validation Accuracy: 0.813000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.1487 Validation Accuracy: 0.823600 Epoch 77, CIFAR-10 Batch 5: Loss: 0.1465 Validation Accuracy: 0.800600 Epoch 78, CIFAR-10 Batch 1: Loss: 0.1438 Validation Accuracy: 0.779400 Epoch 78, CIFAR-10 Batch 2: Loss: 0.1465 Validation Accuracy: 0.821000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.1463 Validation Accuracy: 0.803000 Epoch 78, CIFAR-10 Batch 4: Loss: 0.1497 Validation Accuracy: 0.827200 Epoch 78, CIFAR-10 Batch 5: Loss: 0.1466 Validation Accuracy: 0.833200 Epoch 79, CIFAR-10 Batch 1: Loss: 0.1445 Validation Accuracy: 0.783600 Epoch 79, CIFAR-10 Batch 2: Loss: 0.1467 Validation Accuracy: 0.820200 Epoch 79, CIFAR-10 Batch 3: Loss: 0.1451 Validation Accuracy: 0.829600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.1462 Validation Accuracy: 0.809400 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1480 Validation Accuracy: 0.838400 Epoch 80, CIFAR-10 Batch 1: Loss: 0.1446 Validation Accuracy: 0.828400 Epoch 80, CIFAR-10 Batch 2: Loss: 0.1455 Validation Accuracy: 0.791000 Epoch 80, CIFAR-10 Batch 3: Loss: 0.1434 Validation Accuracy: 0.835400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.1431 Validation Accuracy: 0.758400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.1443 Validation Accuracy: 0.804000 Epoch 81, CIFAR-10 Batch 1: Loss: 0.1492 Validation Accuracy: 0.842000 Epoch 81, CIFAR-10 Batch 2: Loss: 0.1450 Validation Accuracy: 0.834400 Epoch 81, CIFAR-10 Batch 3: Loss: 0.1458 Validation Accuracy: 0.835600 Epoch 81, CIFAR-10 Batch 4: Loss: 0.1470 Validation Accuracy: 0.801000 Epoch 81, CIFAR-10 Batch 5: Loss: 0.1458 Validation Accuracy: 0.788200 Epoch 82, CIFAR-10 Batch 1: Loss: 0.1449 Validation Accuracy: 0.875400 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1444 Validation Accuracy: 0.887200 Epoch 82, CIFAR-10 Batch 3: Loss: 0.1420 Validation Accuracy: 0.889600 Epoch 82, CIFAR-10 Batch 4: Loss: 0.1395 Validation Accuracy: 0.892400 Epoch 82, CIFAR-10 Batch 5: Loss: 0.1373 Validation Accuracy: 0.889800 Epoch 83, CIFAR-10 Batch 1: Loss: 0.1371 Validation Accuracy: 0.894400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.1378 Validation Accuracy: 0.894600 Epoch 83, CIFAR-10 Batch 3: Loss: 0.1376 Validation Accuracy: 0.896200 Epoch 83, CIFAR-10 Batch 4: Loss: 0.1369 Validation Accuracy: 0.896200 Epoch 83, CIFAR-10 Batch 5: Loss: 0.1363 Validation Accuracy: 0.895400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.1363 Validation Accuracy: 0.895400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.1371 Validation Accuracy: 0.895800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 84, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 84, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 85, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 85, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 85, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 85, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894600 Epoch 86, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 86, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 86, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 87, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 87, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 87, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 88, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895800 Epoch 88, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.896200 Epoch 88, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 89, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 89, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 89, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 90, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 90, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 90, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 91, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 91, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 92, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 92, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 92, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 92, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 92, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 93, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 93, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 94, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 94, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 94, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 94, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 94, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 95, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 95, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 95, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 95, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 96, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 96, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 96, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 97, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 97, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 97, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 97, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 98, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 98, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 98, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 98, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 99, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 99, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 99, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.894600 Epoch 99, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 99, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 100, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 100, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 100, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 101, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 101, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 102, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 102, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 102, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 102, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 102, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 103, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 103, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 103, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 104, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 104, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 104, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 104, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 105, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 105, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 105, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 106, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 106, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 106, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 107, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 107, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 108, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 108, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 108, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 109, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 109, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 110, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 110, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 110, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 110, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 111, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 111, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 111, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 111, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 112, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 112, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 112, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 112, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 113, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894600 Epoch 113, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 113, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 113, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 114, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 115, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 115, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 115, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 115, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 116, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 116, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 116, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 116, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 117, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 117, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 117, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 117, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 118, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 118, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 118, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 118, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 118, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 119, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 119, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 119, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 120, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 120, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 120, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 120, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 121, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 121, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 121, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 122, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 122, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 122, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 122, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 123, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 123, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 123, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 123, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 123, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 124, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894600 Epoch 124, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 124, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 124, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 124, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 125, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 125, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.896200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 126, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 126, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 126, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 126, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 127, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 127, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 127, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 127, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 127, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 128, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 128, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894600 Epoch 128, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 128, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 128, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 129, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 129, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 129, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 129, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 129, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 130, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 130, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 130, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 130, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 131, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 131, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 131, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 131, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 131, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 132, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 132, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 132, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 132, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895600 Epoch 133, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 133, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 133, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 133, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 133, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 134, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 134, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 134, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 134, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 134, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 135, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 135, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 135, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 135, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 136, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 136, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 136, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 136, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 136, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 137, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 137, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 137, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 138, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 138, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 138, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 138, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 139, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 139, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 139, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 140, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 140, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 140, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 140, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 141, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 141, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 141, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 141, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 142, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 142, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 142, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 143, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 143, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 143, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 143, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 144, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 144, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 144, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 144, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 145, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 145, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 145, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 145, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 146, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 146, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 146, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 146, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 147, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 147, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 147, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 147, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895800 Epoch 147, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 148, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 148, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 148, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 148, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 149, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 149, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 149, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 150, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 150, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 150, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 150, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 151, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 151, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 151, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 152, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 152, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 152, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 152, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 152, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 153, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 153, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894600 Epoch 153, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 153, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 154, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 154, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 154, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895600 Epoch 154, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 154, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895400 Epoch 155, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 155, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 155, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 156, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894600 Epoch 156, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 156, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 157, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 157, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 157, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 158, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 158, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 158, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 158, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 159, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 159, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 159, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 159, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 160, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 160, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 160, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 161, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 161, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 161, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895600 Epoch 161, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895200 Epoch 162, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 162, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 163, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.894800 Epoch 163, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 163, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895000 Epoch 163, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 163, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 164, CIFAR-10 Batch 1: Loss: 0.1362 Validation Accuracy: 0.895000 Epoch 164, CIFAR-10 Batch 2: Loss: 0.1370 Validation Accuracy: 0.894800 Epoch 164, CIFAR-10 Batch 3: Loss: 0.1370 Validation Accuracy: 0.895200 Epoch 164, CIFAR-10 Batch 4: Loss: 0.1366 Validation Accuracy: 0.895000 Epoch 164, CIFAR-10 Batch 5: Loss: 0.1362 Validation Accuracy: 0.895000 Training for learning_rate=0.00100, batch_size=256 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.6774 Validation Accuracy: 0.126000 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6823 Validation Accuracy: 0.162200 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3699 Validation Accuracy: 0.272000 Epoch 1, CIFAR-10 Batch 4: Loss: 1.2992 Validation Accuracy: 0.243400 Epoch 1, CIFAR-10 Batch 5: Loss: 1.2668 Validation Accuracy: 0.374400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.1240 Validation Accuracy: 0.367800 Epoch 2, CIFAR-10 Batch 2: Loss: 1.2992 Validation Accuracy: 0.377200 Epoch 2, CIFAR-10 Batch 3: Loss: 0.9048 Validation Accuracy: 0.465000 Epoch 2, CIFAR-10 Batch 4: Loss: 0.9568 Validation Accuracy: 0.565000 Epoch 2, CIFAR-10 Batch 5: Loss: 0.9519 Validation Accuracy: 0.553800 Epoch 3, CIFAR-10 Batch 1: Loss: 0.8429 Validation Accuracy: 0.584000 Epoch 3, CIFAR-10 Batch 2: Loss: 1.0079 Validation Accuracy: 0.553000 Epoch 3, CIFAR-10 Batch 3: Loss: 0.6805 Validation Accuracy: 0.643600 Epoch 3, CIFAR-10 Batch 4: Loss: 0.7619 Validation Accuracy: 0.682400 Epoch 3, CIFAR-10 Batch 5: Loss: 0.7395 Validation Accuracy: 0.653600 Epoch 4, CIFAR-10 Batch 1: Loss: 0.6510 Validation Accuracy: 0.606200 Epoch 4, CIFAR-10 Batch 2: Loss: 0.7747 Validation Accuracy: 0.572400 Epoch 4, CIFAR-10 Batch 3: Loss: 0.5592 Validation Accuracy: 0.673600 Epoch 4, CIFAR-10 Batch 4: Loss: 0.6299 Validation Accuracy: 0.689200 Epoch 4, CIFAR-10 Batch 5: Loss: 0.5058 Validation Accuracy: 0.660600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.4979 Validation Accuracy: 0.684600 Epoch 5, CIFAR-10 Batch 2: Loss: 0.5742 Validation Accuracy: 0.632200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.4649 Validation Accuracy: 0.655400 Epoch 5, CIFAR-10 Batch 4: Loss: 0.4855 Validation Accuracy: 0.697600 Epoch 5, CIFAR-10 Batch 5: Loss: 0.3772 Validation Accuracy: 0.742800 Epoch 6, CIFAR-10 Batch 1: Loss: 0.4217 Validation Accuracy: 0.758800 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4605 Validation Accuracy: 0.720400 Epoch 6, CIFAR-10 Batch 3: Loss: 0.3893 Validation Accuracy: 0.711400 Epoch 6, CIFAR-10 Batch 4: Loss: 0.4136 Validation Accuracy: 0.724200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.3224 Validation Accuracy: 0.710800 Epoch 7, CIFAR-10 Batch 1: Loss: 0.3224 Validation Accuracy: 0.756800 Epoch 7, CIFAR-10 Batch 2: Loss: 0.3796 Validation Accuracy: 0.757000 Epoch 7, CIFAR-10 Batch 3: Loss: 0.3232 Validation Accuracy: 0.738400 Epoch 7, CIFAR-10 Batch 4: Loss: 0.3507 Validation Accuracy: 0.797000 Epoch 7, CIFAR-10 Batch 5: Loss: 0.2769 Validation Accuracy: 0.774600 Epoch 8, CIFAR-10 Batch 1: Loss: 0.2536 Validation Accuracy: 0.770400 Epoch 8, CIFAR-10 Batch 2: Loss: 0.2982 Validation Accuracy: 0.761200 Epoch 8, CIFAR-10 Batch 3: Loss: 0.2810 Validation Accuracy: 0.740800 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3088 Validation Accuracy: 0.770400 Epoch 8, CIFAR-10 Batch 5: Loss: 0.2186 Validation Accuracy: 0.748800 Epoch 9, CIFAR-10 Batch 1: Loss: 0.2137 Validation Accuracy: 0.777600 Epoch 9, CIFAR-10 Batch 2: Loss: 0.2456 Validation Accuracy: 0.764600 Epoch 9, CIFAR-10 Batch 3: Loss: 0.2413 Validation Accuracy: 0.756400 Epoch 9, CIFAR-10 Batch 4: Loss: 0.2512 Validation Accuracy: 0.793600 Epoch 9, CIFAR-10 Batch 5: Loss: 0.1808 Validation Accuracy: 0.748400 Epoch 10, CIFAR-10 Batch 1: Loss: 0.1848 Validation Accuracy: 0.786000 Epoch 10, CIFAR-10 Batch 2: Loss: 0.2193 Validation Accuracy: 0.733400 Epoch 10, CIFAR-10 Batch 3: Loss: 0.2406 Validation Accuracy: 0.776600 Epoch 10, CIFAR-10 Batch 4: Loss: 0.2153 Validation Accuracy: 0.773200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.1260 Validation Accuracy: 0.790600 Epoch 11, CIFAR-10 Batch 1: Loss: 0.1385 Validation Accuracy: 0.798400 Epoch 11, CIFAR-10 Batch 2: Loss: 0.1951 Validation Accuracy: 0.761000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.2205 Validation Accuracy: 0.818000 Epoch 11, CIFAR-10 Batch 4: Loss: 0.1855 Validation Accuracy: 0.811200 Epoch 11, CIFAR-10 Batch 5: Loss: 0.1105 Validation Accuracy: 0.786400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.1301 Validation Accuracy: 0.801600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.1697 Validation Accuracy: 0.748800 Epoch 12, CIFAR-10 Batch 3: Loss: 0.1872 Validation Accuracy: 0.786200 Epoch 12, CIFAR-10 Batch 4: Loss: 0.1537 Validation Accuracy: 0.786800 Epoch 12, CIFAR-10 Batch 5: Loss: 0.1050 Validation Accuracy: 0.778200 Epoch 13, CIFAR-10 Batch 1: Loss: 0.1127 Validation Accuracy: 0.840000 Epoch 13, CIFAR-10 Batch 2: Loss: 0.1455 Validation Accuracy: 0.783200 Epoch 13, CIFAR-10 Batch 3: Loss: 0.1502 Validation Accuracy: 0.786200 Epoch 13, CIFAR-10 Batch 4: Loss: 0.1438 Validation Accuracy: 0.802400 Epoch 13, CIFAR-10 Batch 5: Loss: 0.0895 Validation Accuracy: 0.805800 Epoch 14, CIFAR-10 Batch 1: Loss: 0.0989 Validation Accuracy: 0.841000 Epoch 14, CIFAR-10 Batch 2: Loss: 0.1431 Validation Accuracy: 0.760800 Epoch 14, CIFAR-10 Batch 3: Loss: 0.1345 Validation Accuracy: 0.804200 Epoch 14, CIFAR-10 Batch 4: Loss: 0.1359 Validation Accuracy: 0.733800 Epoch 14, CIFAR-10 Batch 5: Loss: 0.0840 Validation Accuracy: 0.804800 Epoch 15, CIFAR-10 Batch 1: Loss: 0.0835 Validation Accuracy: 0.778800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.1164 Validation Accuracy: 0.804400 Epoch 15, CIFAR-10 Batch 3: Loss: 0.1281 Validation Accuracy: 0.797000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.1120 Validation Accuracy: 0.798400 Epoch 15, CIFAR-10 Batch 5: Loss: 0.0792 Validation Accuracy: 0.803400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.0877 Validation Accuracy: 0.818400 Epoch 16, CIFAR-10 Batch 2: Loss: 0.1068 Validation Accuracy: 0.797000 Epoch 16, CIFAR-10 Batch 3: Loss: 0.1039 Validation Accuracy: 0.814600 Epoch 16, CIFAR-10 Batch 4: Loss: 0.0959 Validation Accuracy: 0.809400 Epoch 16, CIFAR-10 Batch 5: Loss: 0.0712 Validation Accuracy: 0.815600 Epoch 17, CIFAR-10 Batch 1: Loss: 0.0738 Validation Accuracy: 0.772000 Epoch 17, CIFAR-10 Batch 2: Loss: 0.0983 Validation Accuracy: 0.819600 Epoch 17, CIFAR-10 Batch 3: Loss: 0.1051 Validation Accuracy: 0.804600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.0936 Validation Accuracy: 0.802000 Epoch 17, CIFAR-10 Batch 5: Loss: 0.0680 Validation Accuracy: 0.829200 Epoch 18, CIFAR-10 Batch 1: Loss: 0.0733 Validation Accuracy: 0.793600 Epoch 18, CIFAR-10 Batch 2: Loss: 0.0906 Validation Accuracy: 0.809400 Epoch 18, CIFAR-10 Batch 3: Loss: 0.0876 Validation Accuracy: 0.816000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.0863 Validation Accuracy: 0.785600 Epoch 18, CIFAR-10 Batch 5: Loss: 0.0667 Validation Accuracy: 0.840600 Epoch 19, CIFAR-10 Batch 1: Loss: 0.0691 Validation Accuracy: 0.772600 Epoch 19, CIFAR-10 Batch 2: Loss: 0.0949 Validation Accuracy: 0.785200 Epoch 19, CIFAR-10 Batch 3: Loss: 0.0880 Validation Accuracy: 0.814800 Epoch 19, CIFAR-10 Batch 4: Loss: 0.0840 Validation Accuracy: 0.767200 Epoch 19, CIFAR-10 Batch 5: Loss: 0.0666 Validation Accuracy: 0.808200 Epoch 20, CIFAR-10 Batch 1: Loss: 0.0675 Validation Accuracy: 0.817600 Epoch 20, CIFAR-10 Batch 2: Loss: 0.0842 Validation Accuracy: 0.827200 Epoch 20, CIFAR-10 Batch 3: Loss: 0.0795 Validation Accuracy: 0.822400 Epoch 20, CIFAR-10 Batch 4: Loss: 0.0756 Validation Accuracy: 0.836400 Epoch 20, CIFAR-10 Batch 5: Loss: 0.0662 Validation Accuracy: 0.811600 Epoch 21, CIFAR-10 Batch 1: Loss: 0.0675 Validation Accuracy: 0.843400 Epoch 21, CIFAR-10 Batch 2: Loss: 0.0792 Validation Accuracy: 0.819000 Epoch 21, CIFAR-10 Batch 3: Loss: 0.0775 Validation Accuracy: 0.812000 Epoch 21, CIFAR-10 Batch 4: Loss: 0.0742 Validation Accuracy: 0.822400 Epoch 21, CIFAR-10 Batch 5: Loss: 0.0614 Validation Accuracy: 0.800800 Epoch 22, CIFAR-10 Batch 1: Loss: 0.0637 Validation Accuracy: 0.821200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.0766 Validation Accuracy: 0.819000 Epoch 22, CIFAR-10 Batch 3: Loss: 0.0735 Validation Accuracy: 0.813200 Epoch 22, CIFAR-10 Batch 4: Loss: 0.0698 Validation Accuracy: 0.800800 Epoch 22, CIFAR-10 Batch 5: Loss: 0.0620 Validation Accuracy: 0.808000 Epoch 23, CIFAR-10 Batch 1: Loss: 0.0636 Validation Accuracy: 0.748200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.0719 Validation Accuracy: 0.839000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.0820 Validation Accuracy: 0.813600 Epoch 23, CIFAR-10 Batch 4: Loss: 0.0714 Validation Accuracy: 0.831200 Epoch 23, CIFAR-10 Batch 5: Loss: 0.0625 Validation Accuracy: 0.770800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.0594 Validation Accuracy: 0.820200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.0737 Validation Accuracy: 0.819200 Epoch 24, CIFAR-10 Batch 3: Loss: 0.0690 Validation Accuracy: 0.851000 Epoch 24, CIFAR-10 Batch 4: Loss: 0.0704 Validation Accuracy: 0.799800 Epoch 24, CIFAR-10 Batch 5: Loss: 0.0593 Validation Accuracy: 0.818200 Epoch 25, CIFAR-10 Batch 1: Loss: 0.0608 Validation Accuracy: 0.843200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.0690 Validation Accuracy: 0.825200 Epoch 25, CIFAR-10 Batch 3: Loss: 0.0685 Validation Accuracy: 0.847600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.0645 Validation Accuracy: 0.842200 Epoch 25, CIFAR-10 Batch 5: Loss: 0.0571 Validation Accuracy: 0.810600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.0593 Validation Accuracy: 0.817600 Epoch 26, CIFAR-10 Batch 2: Loss: 0.0692 Validation Accuracy: 0.845200 Epoch 26, CIFAR-10 Batch 3: Loss: 0.0720 Validation Accuracy: 0.839200 Epoch 26, CIFAR-10 Batch 4: Loss: 0.0704 Validation Accuracy: 0.780800 Epoch 26, CIFAR-10 Batch 5: Loss: 0.0599 Validation Accuracy: 0.850000 Epoch 27, CIFAR-10 Batch 1: Loss: 0.0613 Validation Accuracy: 0.835600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.0697 Validation Accuracy: 0.853600 Epoch 27, CIFAR-10 Batch 3: Loss: 0.0673 Validation Accuracy: 0.834400 Epoch 27, CIFAR-10 Batch 4: Loss: 0.0635 Validation Accuracy: 0.820800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.0589 Validation Accuracy: 0.823400 Epoch 28, CIFAR-10 Batch 1: Loss: 0.0616 Validation Accuracy: 0.832000 Epoch 28, CIFAR-10 Batch 2: Loss: 0.0670 Validation Accuracy: 0.844200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.0655 Validation Accuracy: 0.835400 Epoch 28, CIFAR-10 Batch 4: Loss: 0.0632 Validation Accuracy: 0.822000 Epoch 28, CIFAR-10 Batch 5: Loss: 0.0573 Validation Accuracy: 0.791800 Epoch 29, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.849600 Epoch 29, CIFAR-10 Batch 2: Loss: 0.0676 Validation Accuracy: 0.856600 Epoch 29, CIFAR-10 Batch 3: Loss: 0.0655 Validation Accuracy: 0.812400 Epoch 29, CIFAR-10 Batch 4: Loss: 0.0635 Validation Accuracy: 0.827400 Epoch 29, CIFAR-10 Batch 5: Loss: 0.0571 Validation Accuracy: 0.850200 Epoch 30, CIFAR-10 Batch 1: Loss: 0.0584 Validation Accuracy: 0.843800 Epoch 30, CIFAR-10 Batch 2: Loss: 0.0677 Validation Accuracy: 0.846400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.0650 Validation Accuracy: 0.837000 Epoch 30, CIFAR-10 Batch 4: Loss: 0.0615 Validation Accuracy: 0.819600 Epoch 30, CIFAR-10 Batch 5: Loss: 0.0583 Validation Accuracy: 0.834200 Epoch 31, CIFAR-10 Batch 1: Loss: 0.0578 Validation Accuracy: 0.839600 Epoch 31, CIFAR-10 Batch 2: Loss: 0.0620 Validation Accuracy: 0.834200 Epoch 31, CIFAR-10 Batch 3: Loss: 0.0627 Validation Accuracy: 0.823000 Epoch 31, CIFAR-10 Batch 4: Loss: 0.0601 Validation Accuracy: 0.865400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.0580 Validation Accuracy: 0.839800 Epoch 32, CIFAR-10 Batch 1: Loss: 0.0582 Validation Accuracy: 0.784400 Epoch 32, CIFAR-10 Batch 2: Loss: 0.0615 Validation Accuracy: 0.856000 Epoch 32, CIFAR-10 Batch 3: Loss: 0.0631 Validation Accuracy: 0.829800 Epoch 32, CIFAR-10 Batch 4: Loss: 0.0629 Validation Accuracy: 0.799600 Epoch 32, CIFAR-10 Batch 5: Loss: 0.0575 Validation Accuracy: 0.851600 Epoch 33, CIFAR-10 Batch 1: Loss: 0.0585 Validation Accuracy: 0.847400 Epoch 33, CIFAR-10 Batch 2: Loss: 0.0614 Validation Accuracy: 0.866200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.0650 Validation Accuracy: 0.850200 Epoch 33, CIFAR-10 Batch 4: Loss: 0.0636 Validation Accuracy: 0.845200 Epoch 33, CIFAR-10 Batch 5: Loss: 0.0574 Validation Accuracy: 0.855200 Epoch 34, CIFAR-10 Batch 1: Loss: 0.0615 Validation Accuracy: 0.859600 Epoch 34, CIFAR-10 Batch 2: Loss: 0.0663 Validation Accuracy: 0.854800 Epoch 34, CIFAR-10 Batch 3: Loss: 0.0632 Validation Accuracy: 0.839400 Epoch 34, CIFAR-10 Batch 4: Loss: 0.0615 Validation Accuracy: 0.837400 Epoch 34, CIFAR-10 Batch 5: Loss: 0.0593 Validation Accuracy: 0.852200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.0590 Validation Accuracy: 0.851600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.0616 Validation Accuracy: 0.841800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.0617 Validation Accuracy: 0.829800 Epoch 35, CIFAR-10 Batch 4: Loss: 0.0633 Validation Accuracy: 0.853200 Epoch 35, CIFAR-10 Batch 5: Loss: 0.0587 Validation Accuracy: 0.861600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.0591 Validation Accuracy: 0.850000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.0631 Validation Accuracy: 0.853600 Epoch 36, CIFAR-10 Batch 3: Loss: 0.0617 Validation Accuracy: 0.857600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.0630 Validation Accuracy: 0.831600 Epoch 36, CIFAR-10 Batch 5: Loss: 0.0582 Validation Accuracy: 0.835000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.852000 Epoch 37, CIFAR-10 Batch 2: Loss: 0.0622 Validation Accuracy: 0.871200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.0634 Validation Accuracy: 0.832600 Epoch 37, CIFAR-10 Batch 4: Loss: 0.0609 Validation Accuracy: 0.854200 Epoch 37, CIFAR-10 Batch 5: Loss: 0.0570 Validation Accuracy: 0.851200 Epoch 38, CIFAR-10 Batch 1: Loss: 0.0609 Validation Accuracy: 0.866400 Epoch 38, CIFAR-10 Batch 2: Loss: 0.0627 Validation Accuracy: 0.860000 Epoch 38, CIFAR-10 Batch 3: Loss: 0.0622 Validation Accuracy: 0.830800 Epoch 38, CIFAR-10 Batch 4: Loss: 0.0601 Validation Accuracy: 0.849200 Epoch 38, CIFAR-10 Batch 5: Loss: 0.0588 Validation Accuracy: 0.844400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.0576 Validation Accuracy: 0.852000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.0619 Validation Accuracy: 0.871200 Epoch 39, CIFAR-10 Batch 3: Loss: 0.0612 Validation Accuracy: 0.820600 Epoch 39, CIFAR-10 Batch 4: Loss: 0.0618 Validation Accuracy: 0.827000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.0591 Validation Accuracy: 0.846800 Epoch 40, CIFAR-10 Batch 1: Loss: 0.0572 Validation Accuracy: 0.845800 Epoch 40, CIFAR-10 Batch 2: Loss: 0.0630 Validation Accuracy: 0.828600 Epoch 40, CIFAR-10 Batch 3: Loss: 0.0601 Validation Accuracy: 0.843200 Epoch 40, CIFAR-10 Batch 4: Loss: 0.0598 Validation Accuracy: 0.831400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.0583 Validation Accuracy: 0.860200 Epoch 41, CIFAR-10 Batch 1: Loss: 0.0574 Validation Accuracy: 0.862000 Epoch 41, CIFAR-10 Batch 2: Loss: 0.0643 Validation Accuracy: 0.832200 Epoch 41, CIFAR-10 Batch 3: Loss: 0.0612 Validation Accuracy: 0.834800 Epoch 41, CIFAR-10 Batch 4: Loss: 0.0637 Validation Accuracy: 0.843600 Epoch 41, CIFAR-10 Batch 5: Loss: 0.0581 Validation Accuracy: 0.873400 Epoch 42, CIFAR-10 Batch 1: Loss: 0.0579 Validation Accuracy: 0.861800 Epoch 42, CIFAR-10 Batch 2: Loss: 0.0629 Validation Accuracy: 0.870200 Epoch 42, CIFAR-10 Batch 3: Loss: 0.0629 Validation Accuracy: 0.849800 Epoch 42, CIFAR-10 Batch 4: Loss: 0.0606 Validation Accuracy: 0.854400 Epoch 42, CIFAR-10 Batch 5: Loss: 0.0585 Validation Accuracy: 0.845000 Epoch 43, CIFAR-10 Batch 1: Loss: 0.0584 Validation Accuracy: 0.846200 Epoch 43, CIFAR-10 Batch 2: Loss: 0.0618 Validation Accuracy: 0.847600 Epoch 43, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.868600 Epoch 43, CIFAR-10 Batch 4: Loss: 0.0608 Validation Accuracy: 0.855800 Epoch 43, CIFAR-10 Batch 5: Loss: 0.0590 Validation Accuracy: 0.864000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.0579 Validation Accuracy: 0.861800 Epoch 44, CIFAR-10 Batch 2: Loss: 0.0619 Validation Accuracy: 0.835800 Epoch 44, CIFAR-10 Batch 3: Loss: 0.0599 Validation Accuracy: 0.863000 Epoch 44, CIFAR-10 Batch 4: Loss: 0.0608 Validation Accuracy: 0.827000 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0579 Validation Accuracy: 0.822200 Epoch 45, CIFAR-10 Batch 1: Loss: 0.0586 Validation Accuracy: 0.843800 Epoch 45, CIFAR-10 Batch 2: Loss: 0.0604 Validation Accuracy: 0.849000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.0596 Validation Accuracy: 0.846800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.0596 Validation Accuracy: 0.849200 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0581 Validation Accuracy: 0.852200 Epoch 46, CIFAR-10 Batch 1: Loss: 0.0580 Validation Accuracy: 0.841800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.0607 Validation Accuracy: 0.849200 Epoch 46, CIFAR-10 Batch 3: Loss: 0.0605 Validation Accuracy: 0.855800 Epoch 46, CIFAR-10 Batch 4: Loss: 0.0594 Validation Accuracy: 0.829400 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0577 Validation Accuracy: 0.854000 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.868000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.0608 Validation Accuracy: 0.832800 Epoch 47, CIFAR-10 Batch 3: Loss: 0.0601 Validation Accuracy: 0.839000 Epoch 47, CIFAR-10 Batch 4: Loss: 0.0601 Validation Accuracy: 0.832400 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0577 Validation Accuracy: 0.870800 Epoch 48, CIFAR-10 Batch 1: Loss: 0.0576 Validation Accuracy: 0.854200 Epoch 48, CIFAR-10 Batch 2: Loss: 0.0607 Validation Accuracy: 0.867000 Epoch 48, CIFAR-10 Batch 3: Loss: 0.0608 Validation Accuracy: 0.854000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.0608 Validation Accuracy: 0.846600 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0582 Validation Accuracy: 0.851400 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0604 Validation Accuracy: 0.823800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.0614 Validation Accuracy: 0.872200 Epoch 49, CIFAR-10 Batch 3: Loss: 0.0611 Validation Accuracy: 0.826800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.0593 Validation Accuracy: 0.853400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0592 Validation Accuracy: 0.859000 Epoch 50, CIFAR-10 Batch 1: Loss: 0.0590 Validation Accuracy: 0.846600 Epoch 50, CIFAR-10 Batch 2: Loss: 0.0601 Validation Accuracy: 0.852000 Epoch 50, CIFAR-10 Batch 3: Loss: 0.0595 Validation Accuracy: 0.864600 Epoch 50, CIFAR-10 Batch 4: Loss: 0.0583 Validation Accuracy: 0.838000 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.844000 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0593 Validation Accuracy: 0.864000 Epoch 51, CIFAR-10 Batch 2: Loss: 0.0622 Validation Accuracy: 0.818600 Epoch 51, CIFAR-10 Batch 3: Loss: 0.0596 Validation Accuracy: 0.833400 Epoch 51, CIFAR-10 Batch 4: Loss: 0.0599 Validation Accuracy: 0.859200 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0591 Validation Accuracy: 0.835200 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0596 Validation Accuracy: 0.844400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.0603 Validation Accuracy: 0.864600 Epoch 52, CIFAR-10 Batch 3: Loss: 0.0600 Validation Accuracy: 0.849000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.0608 Validation Accuracy: 0.865000 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0590 Validation Accuracy: 0.861800 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0585 Validation Accuracy: 0.844600 Epoch 53, CIFAR-10 Batch 2: Loss: 0.0603 Validation Accuracy: 0.862000 Epoch 53, CIFAR-10 Batch 3: Loss: 0.0611 Validation Accuracy: 0.856800 Epoch 53, CIFAR-10 Batch 4: Loss: 0.0594 Validation Accuracy: 0.849000 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0582 Validation Accuracy: 0.852000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0579 Validation Accuracy: 0.864600 Epoch 54, CIFAR-10 Batch 2: Loss: 0.0593 Validation Accuracy: 0.858200 Epoch 54, CIFAR-10 Batch 3: Loss: 0.0600 Validation Accuracy: 0.835400 Epoch 54, CIFAR-10 Batch 4: Loss: 0.0587 Validation Accuracy: 0.835600 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0589 Validation Accuracy: 0.870600 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.874800 Epoch 55, CIFAR-10 Batch 2: Loss: 0.0604 Validation Accuracy: 0.857400 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0591 Validation Accuracy: 0.861600 Epoch 55, CIFAR-10 Batch 4: Loss: 0.0590 Validation Accuracy: 0.861400 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0581 Validation Accuracy: 0.874000 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.864000 Epoch 56, CIFAR-10 Batch 2: Loss: 0.0590 Validation Accuracy: 0.859200 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0626 Validation Accuracy: 0.858400 Epoch 56, CIFAR-10 Batch 4: Loss: 0.0600 Validation Accuracy: 0.860400 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0584 Validation Accuracy: 0.825600 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.869000 Epoch 57, CIFAR-10 Batch 2: Loss: 0.0598 Validation Accuracy: 0.860400 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0634 Validation Accuracy: 0.866600 Epoch 57, CIFAR-10 Batch 4: Loss: 0.0594 Validation Accuracy: 0.870200 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0577 Validation Accuracy: 0.868400 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0578 Validation Accuracy: 0.873600 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0602 Validation Accuracy: 0.879800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0608 Validation Accuracy: 0.850000 Epoch 58, CIFAR-10 Batch 4: Loss: 0.0590 Validation Accuracy: 0.833200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0585 Validation Accuracy: 0.849800 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0596 Validation Accuracy: 0.840400 Epoch 59, CIFAR-10 Batch 2: Loss: 0.0622 Validation Accuracy: 0.851800 Epoch 59, CIFAR-10 Batch 3: Loss: 0.0627 Validation Accuracy: 0.819400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.0595 Validation Accuracy: 0.859400 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0597 Validation Accuracy: 0.871400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0585 Validation Accuracy: 0.861200 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0607 Validation Accuracy: 0.862200 Epoch 60, CIFAR-10 Batch 3: Loss: 0.0602 Validation Accuracy: 0.864400 Epoch 60, CIFAR-10 Batch 4: Loss: 0.0594 Validation Accuracy: 0.809600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0593 Validation Accuracy: 0.853400 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0589 Validation Accuracy: 0.861200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.0604 Validation Accuracy: 0.849600 Epoch 61, CIFAR-10 Batch 3: Loss: 0.0604 Validation Accuracy: 0.866600 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0602 Validation Accuracy: 0.845000 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0590 Validation Accuracy: 0.848400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0589 Validation Accuracy: 0.873800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.0601 Validation Accuracy: 0.842200 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0597 Validation Accuracy: 0.869200 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0605 Validation Accuracy: 0.858600 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0592 Validation Accuracy: 0.860600 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0588 Validation Accuracy: 0.864400 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0592 Validation Accuracy: 0.870000 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0603 Validation Accuracy: 0.874600 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0599 Validation Accuracy: 0.835400 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0583 Validation Accuracy: 0.866800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0584 Validation Accuracy: 0.872600 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0602 Validation Accuracy: 0.866800 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0598 Validation Accuracy: 0.848800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0604 Validation Accuracy: 0.842200 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0583 Validation Accuracy: 0.842200 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0587 Validation Accuracy: 0.853800 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0602 Validation Accuracy: 0.877600 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0596 Validation Accuracy: 0.832800 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0602 Validation Accuracy: 0.865200 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0588 Validation Accuracy: 0.868000 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0588 Validation Accuracy: 0.851000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0611 Validation Accuracy: 0.864000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0604 Validation Accuracy: 0.865000 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0597 Validation Accuracy: 0.843600 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0588 Validation Accuracy: 0.868600 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0589 Validation Accuracy: 0.863800 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0598 Validation Accuracy: 0.869800 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0594 Validation Accuracy: 0.870000 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0589 Validation Accuracy: 0.867000 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0583 Validation Accuracy: 0.876000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.872000 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0601 Validation Accuracy: 0.847200 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0605 Validation Accuracy: 0.861000 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0607 Validation Accuracy: 0.860400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0586 Validation Accuracy: 0.864800 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.872600 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0591 Validation Accuracy: 0.868600 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0589 Validation Accuracy: 0.866800 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0589 Validation Accuracy: 0.836400 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0587 Validation Accuracy: 0.839800 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0593 Validation Accuracy: 0.860800 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0584 Validation Accuracy: 0.859400 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0589 Validation Accuracy: 0.876400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0594 Validation Accuracy: 0.847800 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0593 Validation Accuracy: 0.866800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0590 Validation Accuracy: 0.868800 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0593 Validation Accuracy: 0.873000 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0613 Validation Accuracy: 0.871000 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0596 Validation Accuracy: 0.853200 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0596 Validation Accuracy: 0.847600 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0592 Validation Accuracy: 0.851800 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0605 Validation Accuracy: 0.866600 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0603 Validation Accuracy: 0.860400 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0595 Validation Accuracy: 0.850200 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0590 Validation Accuracy: 0.863600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0587 Validation Accuracy: 0.861400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0599 Validation Accuracy: 0.856400 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0594 Validation Accuracy: 0.869000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0598 Validation Accuracy: 0.861400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0586 Validation Accuracy: 0.863600 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.871800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0628 Validation Accuracy: 0.827600 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0595 Validation Accuracy: 0.861400 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0591 Validation Accuracy: 0.865000 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0590 Validation Accuracy: 0.882000 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.843400 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0597 Validation Accuracy: 0.873800 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0603 Validation Accuracy: 0.856000 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0592 Validation Accuracy: 0.861800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0588 Validation Accuracy: 0.872800 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0582 Validation Accuracy: 0.870600 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0586 Validation Accuracy: 0.866000 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0587 Validation Accuracy: 0.875000 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0585 Validation Accuracy: 0.846200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0584 Validation Accuracy: 0.863000 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0584 Validation Accuracy: 0.861000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0593 Validation Accuracy: 0.869200 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0592 Validation Accuracy: 0.856000 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0593 Validation Accuracy: 0.857400 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0587 Validation Accuracy: 0.855400 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.868800 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0592 Validation Accuracy: 0.863000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0586 Validation Accuracy: 0.865000 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0589 Validation Accuracy: 0.847400 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0582 Validation Accuracy: 0.870400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.860800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0589 Validation Accuracy: 0.842400 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0589 Validation Accuracy: 0.862000 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0592 Validation Accuracy: 0.856600 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0588 Validation Accuracy: 0.864000 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0593 Validation Accuracy: 0.804600 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0598 Validation Accuracy: 0.858600 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0601 Validation Accuracy: 0.862200 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0600 Validation Accuracy: 0.878200 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0593 Validation Accuracy: 0.858800 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0592 Validation Accuracy: 0.863000 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0592 Validation Accuracy: 0.873400 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0594 Validation Accuracy: 0.858800 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0586 Validation Accuracy: 0.847400 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0582 Validation Accuracy: 0.883600 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0581 Validation Accuracy: 0.890200 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0584 Validation Accuracy: 0.894400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0600 Validation Accuracy: 0.893400 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0581 Validation Accuracy: 0.898800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.897800 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.897800 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0581 Validation Accuracy: 0.898200 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0583 Validation Accuracy: 0.899000 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898800 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898200 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898600 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897800 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898600 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897800 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898800 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898800 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898600 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898800 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897600 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898200 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897800 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898600 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898800 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898600 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897800 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.897800 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898400 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898000 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898600 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898600 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898000 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898200 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0577 Validation Accuracy: 0.898400 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0580 Validation Accuracy: 0.898200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0582 Validation Accuracy: 0.898000 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0579 Validation Accuracy: 0.898200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0578 Validation Accuracy: 0.898200 Training for learning_rate=0.00010, batch_size=256 ... Epoch 1, CIFAR-10 Batch 1: Loss: 2.0264 Validation Accuracy: 0.146400 Epoch 1, CIFAR-10 Batch 2: Loss: 2.0324 Validation Accuracy: 0.171400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.8751 Validation Accuracy: 0.167200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.7612 Validation Accuracy: 0.171800 Epoch 1, CIFAR-10 Batch 5: Loss: 1.7852 Validation Accuracy: 0.172800 Epoch 2, CIFAR-10 Batch 1: Loss: 1.5974 Validation Accuracy: 0.189600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.7984 Validation Accuracy: 0.248600 Epoch 2, CIFAR-10 Batch 3: Loss: 1.6391 Validation Accuracy: 0.265400 Epoch 2, CIFAR-10 Batch 4: Loss: 1.5705 Validation Accuracy: 0.286800 Epoch 2, CIFAR-10 Batch 5: Loss: 1.5940 Validation Accuracy: 0.337200 Epoch 3, CIFAR-10 Batch 1: Loss: 1.4527 Validation Accuracy: 0.377000 Epoch 3, CIFAR-10 Batch 2: Loss: 1.6608 Validation Accuracy: 0.407600 Epoch 3, CIFAR-10 Batch 3: Loss: 1.4507 Validation Accuracy: 0.411800 Epoch 3, CIFAR-10 Batch 4: Loss: 1.4177 Validation Accuracy: 0.406400 Epoch 3, CIFAR-10 Batch 5: Loss: 1.4799 Validation Accuracy: 0.426000 Epoch 4, CIFAR-10 Batch 1: Loss: 1.3445 Validation Accuracy: 0.446000 Epoch 4, CIFAR-10 Batch 2: Loss: 1.5528 Validation Accuracy: 0.452600 Epoch 4, CIFAR-10 Batch 3: Loss: 1.2925 Validation Accuracy: 0.473200 Epoch 4, CIFAR-10 Batch 4: Loss: 1.2847 Validation Accuracy: 0.466800 Epoch 4, CIFAR-10 Batch 5: Loss: 1.3787 Validation Accuracy: 0.452800 Epoch 5, CIFAR-10 Batch 1: Loss: 1.2622 Validation Accuracy: 0.471000 Epoch 5, CIFAR-10 Batch 2: Loss: 1.4556 Validation Accuracy: 0.475600 Epoch 5, CIFAR-10 Batch 3: Loss: 1.1871 Validation Accuracy: 0.511400 Epoch 5, CIFAR-10 Batch 4: Loss: 1.2047 Validation Accuracy: 0.506000 Epoch 5, CIFAR-10 Batch 5: Loss: 1.2717 Validation Accuracy: 0.467200 Epoch 6, CIFAR-10 Batch 1: Loss: 1.2341 Validation Accuracy: 0.498800 Epoch 6, CIFAR-10 Batch 2: Loss: 1.3797 Validation Accuracy: 0.487200 Epoch 6, CIFAR-10 Batch 3: Loss: 1.1019 Validation Accuracy: 0.510600 Epoch 6, CIFAR-10 Batch 4: Loss: 1.1554 Validation Accuracy: 0.524800 Epoch 6, CIFAR-10 Batch 5: Loss: 1.1946 Validation Accuracy: 0.474400 Epoch 7, CIFAR-10 Batch 1: Loss: 1.1786 Validation Accuracy: 0.488600 Epoch 7, CIFAR-10 Batch 2: Loss: 1.2938 Validation Accuracy: 0.513600 Epoch 7, CIFAR-10 Batch 3: Loss: 1.0263 Validation Accuracy: 0.524200 Epoch 7, CIFAR-10 Batch 4: Loss: 1.0862 Validation Accuracy: 0.531000 Epoch 7, CIFAR-10 Batch 5: Loss: 1.0994 Validation Accuracy: 0.484200 Epoch 8, CIFAR-10 Batch 1: Loss: 1.1123 Validation Accuracy: 0.515200 Epoch 8, CIFAR-10 Batch 2: Loss: 1.2524 Validation Accuracy: 0.518000 Epoch 8, CIFAR-10 Batch 3: Loss: 0.9492 Validation Accuracy: 0.528400 Epoch 8, CIFAR-10 Batch 4: Loss: 1.0264 Validation Accuracy: 0.564200 Epoch 8, CIFAR-10 Batch 5: Loss: 1.0613 Validation Accuracy: 0.487200 Epoch 9, CIFAR-10 Batch 1: Loss: 1.0776 Validation Accuracy: 0.524600 Epoch 9, CIFAR-10 Batch 2: Loss: 1.1879 Validation Accuracy: 0.511400 Epoch 9, CIFAR-10 Batch 3: Loss: 0.8917 Validation Accuracy: 0.568200 Epoch 9, CIFAR-10 Batch 4: Loss: 0.9836 Validation Accuracy: 0.578000 Epoch 9, CIFAR-10 Batch 5: Loss: 0.9786 Validation Accuracy: 0.516400 Epoch 10, CIFAR-10 Batch 1: Loss: 1.0206 Validation Accuracy: 0.543400 Epoch 10, CIFAR-10 Batch 2: Loss: 1.1356 Validation Accuracy: 0.538000 Epoch 10, CIFAR-10 Batch 3: Loss: 0.8178 Validation Accuracy: 0.577000 Epoch 10, CIFAR-10 Batch 4: Loss: 0.9311 Validation Accuracy: 0.587600 Epoch 10, CIFAR-10 Batch 5: Loss: 0.9325 Validation Accuracy: 0.513400 Epoch 11, CIFAR-10 Batch 1: Loss: 0.9728 Validation Accuracy: 0.549000 Epoch 11, CIFAR-10 Batch 2: Loss: 1.0813 Validation Accuracy: 0.550800 Epoch 11, CIFAR-10 Batch 3: Loss: 0.7774 Validation Accuracy: 0.584000 Epoch 11, CIFAR-10 Batch 4: Loss: 0.9017 Validation Accuracy: 0.590800 Epoch 11, CIFAR-10 Batch 5: Loss: 0.8710 Validation Accuracy: 0.525600 Epoch 12, CIFAR-10 Batch 1: Loss: 0.9235 Validation Accuracy: 0.567200 Epoch 12, CIFAR-10 Batch 2: Loss: 1.0359 Validation Accuracy: 0.562400 Epoch 12, CIFAR-10 Batch 3: Loss: 0.7263 Validation Accuracy: 0.598600 Epoch 12, CIFAR-10 Batch 4: Loss: 0.8446 Validation Accuracy: 0.619200 Epoch 12, CIFAR-10 Batch 5: Loss: 0.8255 Validation Accuracy: 0.543000 Epoch 13, CIFAR-10 Batch 1: Loss: 0.8906 Validation Accuracy: 0.582800 Epoch 13, CIFAR-10 Batch 2: Loss: 0.9799 Validation Accuracy: 0.575200 Epoch 13, CIFAR-10 Batch 3: Loss: 0.6993 Validation Accuracy: 0.571200 Epoch 13, CIFAR-10 Batch 4: Loss: 0.8127 Validation Accuracy: 0.614200 Epoch 13, CIFAR-10 Batch 5: Loss: 0.7917 Validation Accuracy: 0.530200 Epoch 14, CIFAR-10 Batch 1: Loss: 0.8461 Validation Accuracy: 0.609200 Epoch 14, CIFAR-10 Batch 2: Loss: 0.9502 Validation Accuracy: 0.564800 Epoch 14, CIFAR-10 Batch 3: Loss: 0.6706 Validation Accuracy: 0.596800 Epoch 14, CIFAR-10 Batch 4: Loss: 0.7816 Validation Accuracy: 0.616200 Epoch 14, CIFAR-10 Batch 5: Loss: 0.7310 Validation Accuracy: 0.541200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.8064 Validation Accuracy: 0.607800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.9011 Validation Accuracy: 0.588000 Epoch 15, CIFAR-10 Batch 3: Loss: 0.6428 Validation Accuracy: 0.596200 Epoch 15, CIFAR-10 Batch 4: Loss: 0.7398 Validation Accuracy: 0.651800 Epoch 15, CIFAR-10 Batch 5: Loss: 0.7078 Validation Accuracy: 0.567400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.7586 Validation Accuracy: 0.615600 Epoch 16, CIFAR-10 Batch 2: Loss: 0.8691 Validation Accuracy: 0.605000 Epoch 16, CIFAR-10 Batch 3: Loss: 0.6272 Validation Accuracy: 0.598600 Epoch 16, CIFAR-10 Batch 4: Loss: 0.7135 Validation Accuracy: 0.647800 Epoch 16, CIFAR-10 Batch 5: Loss: 0.6660 Validation Accuracy: 0.571000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.7303 Validation Accuracy: 0.637200 Epoch 17, CIFAR-10 Batch 2: Loss: 0.8220 Validation Accuracy: 0.594600 Epoch 17, CIFAR-10 Batch 3: Loss: 0.6001 Validation Accuracy: 0.630000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.6789 Validation Accuracy: 0.672400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.6291 Validation Accuracy: 0.587200 Epoch 18, CIFAR-10 Batch 1: Loss: 0.6927 Validation Accuracy: 0.612600 Epoch 18, CIFAR-10 Batch 2: Loss: 0.7937 Validation Accuracy: 0.596200 Epoch 18, CIFAR-10 Batch 3: Loss: 0.5760 Validation Accuracy: 0.638400 Epoch 18, CIFAR-10 Batch 4: Loss: 0.6568 Validation Accuracy: 0.675600 Epoch 18, CIFAR-10 Batch 5: Loss: 0.6044 Validation Accuracy: 0.595200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.6589 Validation Accuracy: 0.651000 Epoch 19, CIFAR-10 Batch 2: Loss: 0.7561 Validation Accuracy: 0.615000 Epoch 19, CIFAR-10 Batch 3: Loss: 0.5545 Validation Accuracy: 0.619000 Epoch 19, CIFAR-10 Batch 4: Loss: 0.6288 Validation Accuracy: 0.677400 Epoch 19, CIFAR-10 Batch 5: Loss: 0.5808 Validation Accuracy: 0.595000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.6462 Validation Accuracy: 0.662800 Epoch 20, CIFAR-10 Batch 2: Loss: 0.7197 Validation Accuracy: 0.614600 Epoch 20, CIFAR-10 Batch 3: Loss: 0.5384 Validation Accuracy: 0.624000 Epoch 20, CIFAR-10 Batch 4: Loss: 0.6004 Validation Accuracy: 0.682600 Epoch 20, CIFAR-10 Batch 5: Loss: 0.5222 Validation Accuracy: 0.603400 Epoch 21, CIFAR-10 Batch 1: Loss: 0.6075 Validation Accuracy: 0.687800 Epoch 21, CIFAR-10 Batch 2: Loss: 0.6803 Validation Accuracy: 0.640600 Epoch 21, CIFAR-10 Batch 3: Loss: 0.5155 Validation Accuracy: 0.680200 Epoch 21, CIFAR-10 Batch 4: Loss: 0.5764 Validation Accuracy: 0.701800 Epoch 21, CIFAR-10 Batch 5: Loss: 0.4963 Validation Accuracy: 0.633400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.5653 Validation Accuracy: 0.692800 Epoch 22, CIFAR-10 Batch 2: Loss: 0.6700 Validation Accuracy: 0.652800 Epoch 22, CIFAR-10 Batch 3: Loss: 0.4976 Validation Accuracy: 0.661400 Epoch 22, CIFAR-10 Batch 4: Loss: 0.5558 Validation Accuracy: 0.708600 Epoch 22, CIFAR-10 Batch 5: Loss: 0.4726 Validation Accuracy: 0.616400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.5535 Validation Accuracy: 0.701600 Epoch 23, CIFAR-10 Batch 2: Loss: 0.6355 Validation Accuracy: 0.653200 Epoch 23, CIFAR-10 Batch 3: Loss: 0.4786 Validation Accuracy: 0.650800 Epoch 23, CIFAR-10 Batch 4: Loss: 0.5328 Validation Accuracy: 0.712600 Epoch 23, CIFAR-10 Batch 5: Loss: 0.4420 Validation Accuracy: 0.634800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.5216 Validation Accuracy: 0.714600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.6182 Validation Accuracy: 0.668600 Epoch 24, CIFAR-10 Batch 3: Loss: 0.4693 Validation Accuracy: 0.684400 Epoch 24, CIFAR-10 Batch 4: Loss: 0.5095 Validation Accuracy: 0.709600 Epoch 24, CIFAR-10 Batch 5: Loss: 0.4201 Validation Accuracy: 0.638600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.4960 Validation Accuracy: 0.709400 Epoch 25, CIFAR-10 Batch 2: Loss: 0.5772 Validation Accuracy: 0.667800 Epoch 25, CIFAR-10 Batch 3: Loss: 0.4473 Validation Accuracy: 0.685400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.4926 Validation Accuracy: 0.722600 Epoch 25, CIFAR-10 Batch 5: Loss: 0.3913 Validation Accuracy: 0.633000 Epoch 26, CIFAR-10 Batch 1: Loss: 0.4587 Validation Accuracy: 0.704400 Epoch 26, CIFAR-10 Batch 2: Loss: 0.5623 Validation Accuracy: 0.664200 Epoch 26, CIFAR-10 Batch 3: Loss: 0.4334 Validation Accuracy: 0.682200 Epoch 26, CIFAR-10 Batch 4: Loss: 0.4786 Validation Accuracy: 0.697400 Epoch 26, CIFAR-10 Batch 5: Loss: 0.3749 Validation Accuracy: 0.642200 Epoch 27, CIFAR-10 Batch 1: Loss: 0.4490 Validation Accuracy: 0.713200 Epoch 27, CIFAR-10 Batch 2: Loss: 0.5428 Validation Accuracy: 0.673000 Epoch 27, CIFAR-10 Batch 3: Loss: 0.4270 Validation Accuracy: 0.700200 Epoch 27, CIFAR-10 Batch 4: Loss: 0.4655 Validation Accuracy: 0.731600 Epoch 27, CIFAR-10 Batch 5: Loss: 0.3559 Validation Accuracy: 0.647400 Epoch 28, CIFAR-10 Batch 1: Loss: 0.4188 Validation Accuracy: 0.713400 Epoch 28, CIFAR-10 Batch 2: Loss: 0.5194 Validation Accuracy: 0.674800 Epoch 28, CIFAR-10 Batch 3: Loss: 0.4100 Validation Accuracy: 0.709600 Epoch 28, CIFAR-10 Batch 4: Loss: 0.4417 Validation Accuracy: 0.713200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.3284 Validation Accuracy: 0.638200 Epoch 29, CIFAR-10 Batch 1: Loss: 0.4060 Validation Accuracy: 0.701200 Epoch 29, CIFAR-10 Batch 2: Loss: 0.5017 Validation Accuracy: 0.696200 Epoch 29, CIFAR-10 Batch 3: Loss: 0.3961 Validation Accuracy: 0.699600 Epoch 29, CIFAR-10 Batch 4: Loss: 0.4321 Validation Accuracy: 0.735000 Epoch 29, CIFAR-10 Batch 5: Loss: 0.3069 Validation Accuracy: 0.650400 Epoch 30, CIFAR-10 Batch 1: Loss: 0.3852 Validation Accuracy: 0.729800 Epoch 30, CIFAR-10 Batch 2: Loss: 0.4786 Validation Accuracy: 0.697800 Epoch 30, CIFAR-10 Batch 3: Loss: 0.3838 Validation Accuracy: 0.705600 Epoch 30, CIFAR-10 Batch 4: Loss: 0.4202 Validation Accuracy: 0.733800 Epoch 30, CIFAR-10 Batch 5: Loss: 0.2930 Validation Accuracy: 0.660600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.3704 Validation Accuracy: 0.719600 Epoch 31, CIFAR-10 Batch 2: Loss: 0.4649 Validation Accuracy: 0.686800 Epoch 31, CIFAR-10 Batch 3: Loss: 0.3750 Validation Accuracy: 0.732400 Epoch 31, CIFAR-10 Batch 4: Loss: 0.4183 Validation Accuracy: 0.731200 Epoch 31, CIFAR-10 Batch 5: Loss: 0.2767 Validation Accuracy: 0.658000 Epoch 32, CIFAR-10 Batch 1: Loss: 0.3494 Validation Accuracy: 0.730200 Epoch 32, CIFAR-10 Batch 2: Loss: 0.4366 Validation Accuracy: 0.694200 Epoch 32, CIFAR-10 Batch 3: Loss: 0.3631 Validation Accuracy: 0.720400 Epoch 32, CIFAR-10 Batch 4: Loss: 0.4005 Validation Accuracy: 0.736800 Epoch 32, CIFAR-10 Batch 5: Loss: 0.2633 Validation Accuracy: 0.680200 Epoch 33, CIFAR-10 Batch 1: Loss: 0.3193 Validation Accuracy: 0.734200 Epoch 33, CIFAR-10 Batch 2: Loss: 0.4089 Validation Accuracy: 0.705600 Epoch 33, CIFAR-10 Batch 3: Loss: 0.3492 Validation Accuracy: 0.725200 Epoch 33, CIFAR-10 Batch 4: Loss: 0.3842 Validation Accuracy: 0.752000 Epoch 33, CIFAR-10 Batch 5: Loss: 0.2690 Validation Accuracy: 0.672800 Epoch 34, CIFAR-10 Batch 1: Loss: 0.3116 Validation Accuracy: 0.747600 Epoch 34, CIFAR-10 Batch 2: Loss: 0.3885 Validation Accuracy: 0.716600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.3361 Validation Accuracy: 0.721400 Epoch 34, CIFAR-10 Batch 4: Loss: 0.3709 Validation Accuracy: 0.745800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.2425 Validation Accuracy: 0.663200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.2981 Validation Accuracy: 0.726200 Epoch 35, CIFAR-10 Batch 2: Loss: 0.3793 Validation Accuracy: 0.713800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.3216 Validation Accuracy: 0.739200 Epoch 35, CIFAR-10 Batch 4: Loss: 0.3702 Validation Accuracy: 0.745000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.2396 Validation Accuracy: 0.694000 Epoch 36, CIFAR-10 Batch 1: Loss: 0.2820 Validation Accuracy: 0.755000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.3702 Validation Accuracy: 0.720200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.3186 Validation Accuracy: 0.730400 Epoch 36, CIFAR-10 Batch 4: Loss: 0.3519 Validation Accuracy: 0.744400 Epoch 36, CIFAR-10 Batch 5: Loss: 0.2248 Validation Accuracy: 0.684600 Epoch 37, CIFAR-10 Batch 1: Loss: 0.2657 Validation Accuracy: 0.741200 Epoch 37, CIFAR-10 Batch 2: Loss: 0.3512 Validation Accuracy: 0.715200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.3134 Validation Accuracy: 0.757200 Epoch 37, CIFAR-10 Batch 4: Loss: 0.3420 Validation Accuracy: 0.751800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.2183 Validation Accuracy: 0.696600 Epoch 38, CIFAR-10 Batch 1: Loss: 0.2422 Validation Accuracy: 0.747800 Epoch 38, CIFAR-10 Batch 2: Loss: 0.3417 Validation Accuracy: 0.722400 Epoch 38, CIFAR-10 Batch 3: Loss: 0.3017 Validation Accuracy: 0.743400 Epoch 38, CIFAR-10 Batch 4: Loss: 0.3281 Validation Accuracy: 0.758600 Epoch 38, CIFAR-10 Batch 5: Loss: 0.2070 Validation Accuracy: 0.684400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.2344 Validation Accuracy: 0.755000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.3302 Validation Accuracy: 0.717800 Epoch 39, CIFAR-10 Batch 3: Loss: 0.2954 Validation Accuracy: 0.751200 Epoch 39, CIFAR-10 Batch 4: Loss: 0.3205 Validation Accuracy: 0.761200 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1952 Validation Accuracy: 0.706400 Epoch 40, CIFAR-10 Batch 1: Loss: 0.2274 Validation Accuracy: 0.738200 Epoch 40, CIFAR-10 Batch 2: Loss: 0.3219 Validation Accuracy: 0.722800 Epoch 40, CIFAR-10 Batch 3: Loss: 0.2801 Validation Accuracy: 0.760000 Epoch 40, CIFAR-10 Batch 4: Loss: 0.3032 Validation Accuracy: 0.762400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1920 Validation Accuracy: 0.683000 Epoch 41, CIFAR-10 Batch 1: Loss: 0.2151 Validation Accuracy: 0.755200 Epoch 41, CIFAR-10 Batch 2: Loss: 0.2977 Validation Accuracy: 0.732000 Epoch 41, CIFAR-10 Batch 3: Loss: 0.2718 Validation Accuracy: 0.757200 Epoch 41, CIFAR-10 Batch 4: Loss: 0.2923 Validation Accuracy: 0.774800 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1871 Validation Accuracy: 0.703400 Epoch 42, CIFAR-10 Batch 1: Loss: 0.2088 Validation Accuracy: 0.755200 Epoch 42, CIFAR-10 Batch 2: Loss: 0.3002 Validation Accuracy: 0.741800 Epoch 42, CIFAR-10 Batch 3: Loss: 0.2758 Validation Accuracy: 0.759000 Epoch 42, CIFAR-10 Batch 4: Loss: 0.2837 Validation Accuracy: 0.775600 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1827 Validation Accuracy: 0.684400 Epoch 43, CIFAR-10 Batch 1: Loss: 0.2036 Validation Accuracy: 0.757200 Epoch 43, CIFAR-10 Batch 2: Loss: 0.2842 Validation Accuracy: 0.722400 Epoch 43, CIFAR-10 Batch 3: Loss: 0.2594 Validation Accuracy: 0.750000 Epoch 43, CIFAR-10 Batch 4: Loss: 0.2863 Validation Accuracy: 0.763200 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1781 Validation Accuracy: 0.705200 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1933 Validation Accuracy: 0.761600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.2674 Validation Accuracy: 0.742000 Epoch 44, CIFAR-10 Batch 3: Loss: 0.2517 Validation Accuracy: 0.770200 Epoch 44, CIFAR-10 Batch 4: Loss: 0.2787 Validation Accuracy: 0.775200 Epoch 44, CIFAR-10 Batch 5: Loss: 0.1760 Validation Accuracy: 0.721000 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1976 Validation Accuracy: 0.763600 Epoch 45, CIFAR-10 Batch 2: Loss: 0.2576 Validation Accuracy: 0.718200 Epoch 45, CIFAR-10 Batch 3: Loss: 0.2449 Validation Accuracy: 0.749000 Epoch 45, CIFAR-10 Batch 4: Loss: 0.2611 Validation Accuracy: 0.763600 Epoch 45, CIFAR-10 Batch 5: Loss: 0.1652 Validation Accuracy: 0.707200 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1786 Validation Accuracy: 0.771800 Epoch 46, CIFAR-10 Batch 2: Loss: 0.2454 Validation Accuracy: 0.737400 Epoch 46, CIFAR-10 Batch 3: Loss: 0.2393 Validation Accuracy: 0.767600 Epoch 46, CIFAR-10 Batch 4: Loss: 0.2457 Validation Accuracy: 0.776200 Epoch 46, CIFAR-10 Batch 5: Loss: 0.1617 Validation Accuracy: 0.722800 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1725 Validation Accuracy: 0.758600 Epoch 47, CIFAR-10 Batch 2: Loss: 0.2415 Validation Accuracy: 0.732200 Epoch 47, CIFAR-10 Batch 3: Loss: 0.2301 Validation Accuracy: 0.769200 Epoch 47, CIFAR-10 Batch 4: Loss: 0.2475 Validation Accuracy: 0.764800 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1536 Validation Accuracy: 0.693600 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1630 Validation Accuracy: 0.770600 Epoch 48, CIFAR-10 Batch 2: Loss: 0.2341 Validation Accuracy: 0.727600 Epoch 48, CIFAR-10 Batch 3: Loss: 0.2181 Validation Accuracy: 0.762400 Epoch 48, CIFAR-10 Batch 4: Loss: 0.2405 Validation Accuracy: 0.793800 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1482 Validation Accuracy: 0.724600 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1623 Validation Accuracy: 0.775800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.2365 Validation Accuracy: 0.751600 Epoch 49, CIFAR-10 Batch 3: Loss: 0.2159 Validation Accuracy: 0.773600 Epoch 49, CIFAR-10 Batch 4: Loss: 0.2285 Validation Accuracy: 0.778000 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1459 Validation Accuracy: 0.727600 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1585 Validation Accuracy: 0.783800 Epoch 50, CIFAR-10 Batch 2: Loss: 0.2282 Validation Accuracy: 0.766200 Epoch 50, CIFAR-10 Batch 3: Loss: 0.2168 Validation Accuracy: 0.763400 Epoch 50, CIFAR-10 Batch 4: Loss: 0.2246 Validation Accuracy: 0.760800 Epoch 50, CIFAR-10 Batch 5: Loss: 0.1380 Validation Accuracy: 0.725800 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1482 Validation Accuracy: 0.773600 Epoch 51, CIFAR-10 Batch 2: Loss: 0.2127 Validation Accuracy: 0.749200 Epoch 51, CIFAR-10 Batch 3: Loss: 0.2153 Validation Accuracy: 0.765200 Epoch 51, CIFAR-10 Batch 4: Loss: 0.2139 Validation Accuracy: 0.793600 Epoch 51, CIFAR-10 Batch 5: Loss: 0.1359 Validation Accuracy: 0.738000 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1458 Validation Accuracy: 0.786200 Epoch 52, CIFAR-10 Batch 2: Loss: 0.2106 Validation Accuracy: 0.746600 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1991 Validation Accuracy: 0.770800 Epoch 52, CIFAR-10 Batch 4: Loss: 0.2038 Validation Accuracy: 0.773400 Epoch 52, CIFAR-10 Batch 5: Loss: 0.1282 Validation Accuracy: 0.706200 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1430 Validation Accuracy: 0.777600 Epoch 53, CIFAR-10 Batch 2: Loss: 0.2093 Validation Accuracy: 0.753800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1931 Validation Accuracy: 0.780600 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1980 Validation Accuracy: 0.788400 Epoch 53, CIFAR-10 Batch 5: Loss: 0.1238 Validation Accuracy: 0.748200 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1283 Validation Accuracy: 0.803800 Epoch 54, CIFAR-10 Batch 2: Loss: 0.2073 Validation Accuracy: 0.748400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1886 Validation Accuracy: 0.765000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1908 Validation Accuracy: 0.771800 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1209 Validation Accuracy: 0.741200 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1258 Validation Accuracy: 0.774400 Epoch 55, CIFAR-10 Batch 2: Loss: 0.2010 Validation Accuracy: 0.762000 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1757 Validation Accuracy: 0.780000 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1910 Validation Accuracy: 0.799000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.1164 Validation Accuracy: 0.748400 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1239 Validation Accuracy: 0.758200 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1892 Validation Accuracy: 0.763000 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1777 Validation Accuracy: 0.774000 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1849 Validation Accuracy: 0.793600 Epoch 56, CIFAR-10 Batch 5: Loss: 0.1160 Validation Accuracy: 0.718000 Epoch 57, CIFAR-10 Batch 1: Loss: 0.1177 Validation Accuracy: 0.801400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1771 Validation Accuracy: 0.730200 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1726 Validation Accuracy: 0.774200 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1810 Validation Accuracy: 0.801000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1100 Validation Accuracy: 0.753800 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1196 Validation Accuracy: 0.773200 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1738 Validation Accuracy: 0.756800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.1689 Validation Accuracy: 0.779200 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1694 Validation Accuracy: 0.790800 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1130 Validation Accuracy: 0.739600 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1192 Validation Accuracy: 0.759000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1782 Validation Accuracy: 0.743200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1556 Validation Accuracy: 0.784600 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1607 Validation Accuracy: 0.786000 Epoch 59, CIFAR-10 Batch 5: Loss: 0.1065 Validation Accuracy: 0.774400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1084 Validation Accuracy: 0.799400 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1609 Validation Accuracy: 0.758200 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1553 Validation Accuracy: 0.775800 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1551 Validation Accuracy: 0.773600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1006 Validation Accuracy: 0.740200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1074 Validation Accuracy: 0.791800 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1670 Validation Accuracy: 0.751600 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1515 Validation Accuracy: 0.780400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1517 Validation Accuracy: 0.787600 Epoch 61, CIFAR-10 Batch 5: Loss: 0.1026 Validation Accuracy: 0.755400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1033 Validation Accuracy: 0.800800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1597 Validation Accuracy: 0.731600 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1483 Validation Accuracy: 0.792200 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1560 Validation Accuracy: 0.783800 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0968 Validation Accuracy: 0.774000 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0994 Validation Accuracy: 0.793800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1533 Validation Accuracy: 0.763200 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1492 Validation Accuracy: 0.777800 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1470 Validation Accuracy: 0.807800 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0976 Validation Accuracy: 0.729800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1004 Validation Accuracy: 0.772400 Epoch 64, CIFAR-10 Batch 2: Loss: 0.1481 Validation Accuracy: 0.759600 Epoch 64, CIFAR-10 Batch 3: Loss: 0.1460 Validation Accuracy: 0.788200 Epoch 64, CIFAR-10 Batch 4: Loss: 0.1476 Validation Accuracy: 0.777400 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0918 Validation Accuracy: 0.766600 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0928 Validation Accuracy: 0.789600 Epoch 65, CIFAR-10 Batch 2: Loss: 0.1525 Validation Accuracy: 0.772600 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1376 Validation Accuracy: 0.785600 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1394 Validation Accuracy: 0.826000 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0915 Validation Accuracy: 0.760600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0905 Validation Accuracy: 0.794200 Epoch 66, CIFAR-10 Batch 2: Loss: 0.1412 Validation Accuracy: 0.747200 Epoch 66, CIFAR-10 Batch 3: Loss: 0.1436 Validation Accuracy: 0.771400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1354 Validation Accuracy: 0.786400 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0868 Validation Accuracy: 0.744400 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0915 Validation Accuracy: 0.786400 Epoch 67, CIFAR-10 Batch 2: Loss: 0.1395 Validation Accuracy: 0.768000 Epoch 67, CIFAR-10 Batch 3: Loss: 0.1304 Validation Accuracy: 0.761200 Epoch 67, CIFAR-10 Batch 4: Loss: 0.1338 Validation Accuracy: 0.822600 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0861 Validation Accuracy: 0.770600 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0885 Validation Accuracy: 0.820000 Epoch 68, CIFAR-10 Batch 2: Loss: 0.1314 Validation Accuracy: 0.768600 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1303 Validation Accuracy: 0.762800 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1251 Validation Accuracy: 0.806600 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0875 Validation Accuracy: 0.770800 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0852 Validation Accuracy: 0.804800 Epoch 69, CIFAR-10 Batch 2: Loss: 0.1280 Validation Accuracy: 0.760000 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1185 Validation Accuracy: 0.780600 Epoch 69, CIFAR-10 Batch 4: Loss: 0.1187 Validation Accuracy: 0.803800 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0851 Validation Accuracy: 0.759000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0846 Validation Accuracy: 0.798400 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1307 Validation Accuracy: 0.765400 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1221 Validation Accuracy: 0.779000 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1093 Validation Accuracy: 0.801400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0828 Validation Accuracy: 0.771600 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0822 Validation Accuracy: 0.822600 Epoch 71, CIFAR-10 Batch 2: Loss: 0.1230 Validation Accuracy: 0.778600 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1138 Validation Accuracy: 0.798000 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1117 Validation Accuracy: 0.799400 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0756 Validation Accuracy: 0.793800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0768 Validation Accuracy: 0.784000 Epoch 72, CIFAR-10 Batch 2: Loss: 0.1254 Validation Accuracy: 0.766000 Epoch 72, CIFAR-10 Batch 3: Loss: 0.1122 Validation Accuracy: 0.776800 Epoch 72, CIFAR-10 Batch 4: Loss: 0.1115 Validation Accuracy: 0.818400 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0776 Validation Accuracy: 0.776600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0778 Validation Accuracy: 0.794600 Epoch 73, CIFAR-10 Batch 2: Loss: 0.1219 Validation Accuracy: 0.779600 Epoch 73, CIFAR-10 Batch 3: Loss: 0.1070 Validation Accuracy: 0.798000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.1062 Validation Accuracy: 0.795600 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.757000 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0776 Validation Accuracy: 0.792800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1237 Validation Accuracy: 0.759200 Epoch 74, CIFAR-10 Batch 3: Loss: 0.1083 Validation Accuracy: 0.786000 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1012 Validation Accuracy: 0.792200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0734 Validation Accuracy: 0.771000 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0729 Validation Accuracy: 0.796000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1134 Validation Accuracy: 0.783800 Epoch 75, CIFAR-10 Batch 3: Loss: 0.1051 Validation Accuracy: 0.772800 Epoch 75, CIFAR-10 Batch 4: Loss: 0.1022 Validation Accuracy: 0.811600 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0715 Validation Accuracy: 0.780000 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0714 Validation Accuracy: 0.793400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1145 Validation Accuracy: 0.751600 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1035 Validation Accuracy: 0.785400 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0993 Validation Accuracy: 0.815800 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0720 Validation Accuracy: 0.766600 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0723 Validation Accuracy: 0.787000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.1106 Validation Accuracy: 0.790600 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0992 Validation Accuracy: 0.796400 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0986 Validation Accuracy: 0.801800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0711 Validation Accuracy: 0.748800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0702 Validation Accuracy: 0.801200 Epoch 78, CIFAR-10 Batch 2: Loss: 0.1009 Validation Accuracy: 0.742000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0975 Validation Accuracy: 0.788600 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0958 Validation Accuracy: 0.807000 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0669 Validation Accuracy: 0.777400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0685 Validation Accuracy: 0.774400 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0988 Validation Accuracy: 0.772800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0968 Validation Accuracy: 0.784600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0927 Validation Accuracy: 0.809200 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0639 Validation Accuracy: 0.795800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0650 Validation Accuracy: 0.824400 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0961 Validation Accuracy: 0.789800 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0927 Validation Accuracy: 0.794400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0929 Validation Accuracy: 0.825000 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0628 Validation Accuracy: 0.796600 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0642 Validation Accuracy: 0.804800 Epoch 81, CIFAR-10 Batch 2: Loss: 0.1008 Validation Accuracy: 0.765800 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0927 Validation Accuracy: 0.805000 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0853 Validation Accuracy: 0.810200 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0624 Validation Accuracy: 0.781200 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0646 Validation Accuracy: 0.813000 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0919 Validation Accuracy: 0.807600 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0914 Validation Accuracy: 0.808200 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0809 Validation Accuracy: 0.819000 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0623 Validation Accuracy: 0.821800 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0617 Validation Accuracy: 0.819000 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0877 Validation Accuracy: 0.818400 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0910 Validation Accuracy: 0.818000 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0809 Validation Accuracy: 0.819600 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.820400 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820200 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0876 Validation Accuracy: 0.820800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820000 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.819800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821800 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820400 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.819800 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821800 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820400 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.822000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821400 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821200 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821800 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820400 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.820600 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820400 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.821000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.822000 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821400 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.820800 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821800 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821200 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.822000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820200 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821200 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.822000 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821800 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821600 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.819800 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820600 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821200 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821200 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820600 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820800 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.820800 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821400 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821000 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.821000 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820200 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821800 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0614 Validation Accuracy: 0.820800 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0875 Validation Accuracy: 0.821600 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.820400 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.821000 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0619 Validation Accuracy: 0.821600 Training for learning_rate=0.10000, batch_size=128 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.8677 Validation Accuracy: 0.106800 Epoch 1, CIFAR-10 Batch 2: Loss: 1.7193 Validation Accuracy: 0.112600 Epoch 1, CIFAR-10 Batch 3: Loss: 1.4853 Validation Accuracy: 0.241600 Epoch 1, CIFAR-10 Batch 4: Loss: 1.5085 Validation Accuracy: 0.215600 Epoch 1, CIFAR-10 Batch 5: Loss: 1.4875 Validation Accuracy: 0.443400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.1980 Validation Accuracy: 0.409000 Epoch 2, CIFAR-10 Batch 2: Loss: 1.4281 Validation Accuracy: 0.406400 Epoch 2, CIFAR-10 Batch 3: Loss: 1.3218 Validation Accuracy: 0.280800 Epoch 2, CIFAR-10 Batch 4: Loss: 1.1311 Validation Accuracy: 0.231000 Epoch 2, CIFAR-10 Batch 5: Loss: 1.2677 Validation Accuracy: 0.347600 Epoch 3, CIFAR-10 Batch 1: Loss: 1.0097 Validation Accuracy: 0.271400 Epoch 3, CIFAR-10 Batch 2: Loss: 1.4185 Validation Accuracy: 0.418400 Epoch 3, CIFAR-10 Batch 3: Loss: 1.2586 Validation Accuracy: 0.427000 Epoch 3, CIFAR-10 Batch 4: Loss: 1.1255 Validation Accuracy: 0.374200 Epoch 3, CIFAR-10 Batch 5: Loss: 1.2240 Validation Accuracy: 0.390000 Epoch 4, CIFAR-10 Batch 1: Loss: 1.0319 Validation Accuracy: 0.457600 Epoch 4, CIFAR-10 Batch 2: Loss: 1.1921 Validation Accuracy: 0.473000 Epoch 4, CIFAR-10 Batch 3: Loss: 1.1571 Validation Accuracy: 0.480400 Epoch 4, CIFAR-10 Batch 4: Loss: 1.0704 Validation Accuracy: 0.465400 Epoch 4, CIFAR-10 Batch 5: Loss: 1.2447 Validation Accuracy: 0.486600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.9187 Validation Accuracy: 0.288000 Epoch 5, CIFAR-10 Batch 2: Loss: 1.1708 Validation Accuracy: 0.571200 Epoch 5, CIFAR-10 Batch 3: Loss: 1.0684 Validation Accuracy: 0.425600 Epoch 5, CIFAR-10 Batch 4: Loss: 0.9982 Validation Accuracy: 0.461600 Epoch 5, CIFAR-10 Batch 5: Loss: 1.1012 Validation Accuracy: 0.399800 Epoch 6, CIFAR-10 Batch 1: Loss: 0.8889 Validation Accuracy: 0.393800 Epoch 6, CIFAR-10 Batch 2: Loss: 1.1798 Validation Accuracy: 0.349800 Epoch 6, CIFAR-10 Batch 3: Loss: 1.0157 Validation Accuracy: 0.332400 Epoch 6, CIFAR-10 Batch 4: Loss: 0.9477 Validation Accuracy: 0.382800 Epoch 6, CIFAR-10 Batch 5: Loss: 1.0596 Validation Accuracy: 0.292600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.8764 Validation Accuracy: 0.454800 Epoch 7, CIFAR-10 Batch 2: Loss: 1.1452 Validation Accuracy: 0.385800 Epoch 7, CIFAR-10 Batch 3: Loss: 0.9425 Validation Accuracy: 0.522800 Epoch 7, CIFAR-10 Batch 4: Loss: 0.9193 Validation Accuracy: 0.267000 Epoch 7, CIFAR-10 Batch 5: Loss: 1.0118 Validation Accuracy: 0.311200 Epoch 8, CIFAR-10 Batch 1: Loss: 0.7757 Validation Accuracy: 0.532200 Epoch 8, CIFAR-10 Batch 2: Loss: 1.1544 Validation Accuracy: 0.424400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.8944 Validation Accuracy: 0.493600 Epoch 8, CIFAR-10 Batch 4: Loss: 0.9085 Validation Accuracy: 0.304000 Epoch 8, CIFAR-10 Batch 5: Loss: 1.0960 Validation Accuracy: 0.250200 Epoch 9, CIFAR-10 Batch 1: Loss: 0.8377 Validation Accuracy: 0.480000 Epoch 9, CIFAR-10 Batch 2: Loss: 1.0829 Validation Accuracy: 0.407200 Epoch 9, CIFAR-10 Batch 3: Loss: 0.8550 Validation Accuracy: 0.365600 Epoch 9, CIFAR-10 Batch 4: Loss: 0.9433 Validation Accuracy: 0.333200 Epoch 9, CIFAR-10 Batch 5: Loss: 0.9658 Validation Accuracy: 0.291200 Epoch 10, CIFAR-10 Batch 1: Loss: 0.8066 Validation Accuracy: 0.387600 Epoch 10, CIFAR-10 Batch 2: Loss: 0.9922 Validation Accuracy: 0.518000 Epoch 10, CIFAR-10 Batch 3: Loss: 0.8900 Validation Accuracy: 0.457200 Epoch 10, CIFAR-10 Batch 4: Loss: 0.8402 Validation Accuracy: 0.376200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.7893 Validation Accuracy: 0.487800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.7564 Validation Accuracy: 0.519400 Epoch 11, CIFAR-10 Batch 2: Loss: 0.8586 Validation Accuracy: 0.416000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.8078 Validation Accuracy: 0.495800 Epoch 11, CIFAR-10 Batch 4: Loss: 0.7920 Validation Accuracy: 0.539000 Epoch 11, CIFAR-10 Batch 5: Loss: 0.8114 Validation Accuracy: 0.490400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.7493 Validation Accuracy: 0.501800 Epoch 12, CIFAR-10 Batch 2: Loss: 0.9737 Validation Accuracy: 0.587800 Epoch 12, CIFAR-10 Batch 3: Loss: 0.8164 Validation Accuracy: 0.608400 Epoch 12, CIFAR-10 Batch 4: Loss: 0.8245 Validation Accuracy: 0.573600 Epoch 12, CIFAR-10 Batch 5: Loss: 0.7975 Validation Accuracy: 0.542800 Epoch 13, CIFAR-10 Batch 1: Loss: 0.7444 Validation Accuracy: 0.554800 Epoch 13, CIFAR-10 Batch 2: Loss: 0.8228 Validation Accuracy: 0.608000 Epoch 13, CIFAR-10 Batch 3: Loss: 0.7085 Validation Accuracy: 0.620400 Epoch 13, CIFAR-10 Batch 4: Loss: 0.7766 Validation Accuracy: 0.568600 Epoch 13, CIFAR-10 Batch 5: Loss: 0.7817 Validation Accuracy: 0.480600 Epoch 14, CIFAR-10 Batch 1: Loss: 0.7567 Validation Accuracy: 0.574600 Epoch 14, CIFAR-10 Batch 2: Loss: 0.9179 Validation Accuracy: 0.598000 Epoch 14, CIFAR-10 Batch 3: Loss: 0.7679 Validation Accuracy: 0.458600 Epoch 14, CIFAR-10 Batch 4: Loss: 0.8303 Validation Accuracy: 0.523400 Epoch 14, CIFAR-10 Batch 5: Loss: 0.7131 Validation Accuracy: 0.460600 Epoch 15, CIFAR-10 Batch 1: Loss: 0.6826 Validation Accuracy: 0.443200 Epoch 15, CIFAR-10 Batch 2: Loss: 0.8811 Validation Accuracy: 0.524200 Epoch 15, CIFAR-10 Batch 3: Loss: 0.8029 Validation Accuracy: 0.554800 Epoch 15, CIFAR-10 Batch 4: Loss: 0.7365 Validation Accuracy: 0.599800 Epoch 15, CIFAR-10 Batch 5: Loss: 0.8202 Validation Accuracy: 0.471400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.6453 Validation Accuracy: 0.576600 Epoch 16, CIFAR-10 Batch 2: Loss: 0.9890 Validation Accuracy: 0.594600 Epoch 16, CIFAR-10 Batch 3: Loss: 0.7303 Validation Accuracy: 0.582000 Epoch 16, CIFAR-10 Batch 4: Loss: 0.7468 Validation Accuracy: 0.650600 Epoch 16, CIFAR-10 Batch 5: Loss: 0.7429 Validation Accuracy: 0.560400 Epoch 17, CIFAR-10 Batch 1: Loss: 0.7263 Validation Accuracy: 0.602600 Epoch 17, CIFAR-10 Batch 2: Loss: 0.9046 Validation Accuracy: 0.636800 Epoch 17, CIFAR-10 Batch 3: Loss: 0.7086 Validation Accuracy: 0.597000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.7514 Validation Accuracy: 0.531200 Epoch 17, CIFAR-10 Batch 5: Loss: 0.6752 Validation Accuracy: 0.597000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.7119 Validation Accuracy: 0.636600 Epoch 18, CIFAR-10 Batch 2: Loss: 0.8848 Validation Accuracy: 0.529000 Epoch 18, CIFAR-10 Batch 3: Loss: 0.6579 Validation Accuracy: 0.398400 Epoch 18, CIFAR-10 Batch 4: Loss: 0.8334 Validation Accuracy: 0.565600 Epoch 18, CIFAR-10 Batch 5: Loss: 0.6661 Validation Accuracy: 0.487200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.6023 Validation Accuracy: 0.522000 Epoch 19, CIFAR-10 Batch 2: Loss: 0.7897 Validation Accuracy: 0.534200 Epoch 19, CIFAR-10 Batch 3: Loss: 0.6654 Validation Accuracy: 0.589400 Epoch 19, CIFAR-10 Batch 4: Loss: 0.7310 Validation Accuracy: 0.570200 Epoch 19, CIFAR-10 Batch 5: Loss: 0.7112 Validation Accuracy: 0.543600 Epoch 20, CIFAR-10 Batch 1: Loss: 0.6393 Validation Accuracy: 0.578400 Epoch 20, CIFAR-10 Batch 2: Loss: 0.7850 Validation Accuracy: 0.456000 Epoch 20, CIFAR-10 Batch 3: Loss: 0.6689 Validation Accuracy: 0.498400 Epoch 20, CIFAR-10 Batch 4: Loss: 0.6997 Validation Accuracy: 0.556600 Epoch 20, CIFAR-10 Batch 5: Loss: 0.6461 Validation Accuracy: 0.603000 Epoch 21, CIFAR-10 Batch 1: Loss: 0.6971 Validation Accuracy: 0.637000 Epoch 21, CIFAR-10 Batch 2: Loss: 0.7564 Validation Accuracy: 0.450600 Epoch 21, CIFAR-10 Batch 3: Loss: 0.6942 Validation Accuracy: 0.636600 Epoch 21, CIFAR-10 Batch 4: Loss: 0.6407 Validation Accuracy: 0.704800 Epoch 21, CIFAR-10 Batch 5: Loss: 0.6537 Validation Accuracy: 0.570600 Epoch 22, CIFAR-10 Batch 1: Loss: 0.6961 Validation Accuracy: 0.524800 Epoch 22, CIFAR-10 Batch 2: Loss: 0.8303 Validation Accuracy: 0.580400 Epoch 22, CIFAR-10 Batch 3: Loss: 0.6151 Validation Accuracy: 0.537800 Epoch 22, CIFAR-10 Batch 4: Loss: 0.6427 Validation Accuracy: 0.604400 Epoch 22, CIFAR-10 Batch 5: Loss: 0.7145 Validation Accuracy: 0.586400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.5887 Validation Accuracy: 0.446800 Epoch 23, CIFAR-10 Batch 2: Loss: 0.6997 Validation Accuracy: 0.559600 Epoch 23, CIFAR-10 Batch 3: Loss: 0.6965 Validation Accuracy: 0.413800 Epoch 23, CIFAR-10 Batch 4: Loss: 0.6242 Validation Accuracy: 0.671400 Epoch 23, CIFAR-10 Batch 5: Loss: 0.5972 Validation Accuracy: 0.580600 Epoch 24, CIFAR-10 Batch 1: Loss: 0.5343 Validation Accuracy: 0.663600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.8439 Validation Accuracy: 0.682200 Epoch 24, CIFAR-10 Batch 3: Loss: 0.6139 Validation Accuracy: 0.591000 Epoch 24, CIFAR-10 Batch 4: Loss: 0.6238 Validation Accuracy: 0.577000 Epoch 24, CIFAR-10 Batch 5: Loss: 0.6542 Validation Accuracy: 0.570600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.6229 Validation Accuracy: 0.582800 Epoch 25, CIFAR-10 Batch 2: Loss: 0.7310 Validation Accuracy: 0.700200 Epoch 25, CIFAR-10 Batch 3: Loss: 0.5923 Validation Accuracy: 0.594600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.6040 Validation Accuracy: 0.602400 Epoch 25, CIFAR-10 Batch 5: Loss: 0.6334 Validation Accuracy: 0.631800 Epoch 26, CIFAR-10 Batch 1: Loss: 0.5780 Validation Accuracy: 0.626600 Epoch 26, CIFAR-10 Batch 2: Loss: 0.7319 Validation Accuracy: 0.555200 Epoch 26, CIFAR-10 Batch 3: Loss: 0.6219 Validation Accuracy: 0.594200 Epoch 26, CIFAR-10 Batch 4: Loss: 0.5997 Validation Accuracy: 0.658600 Epoch 26, CIFAR-10 Batch 5: Loss: 0.6268 Validation Accuracy: 0.573600 Epoch 27, CIFAR-10 Batch 1: Loss: 0.5976 Validation Accuracy: 0.573600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.6516 Validation Accuracy: 0.445400 Epoch 27, CIFAR-10 Batch 3: Loss: 0.6532 Validation Accuracy: 0.707800 Epoch 27, CIFAR-10 Batch 4: Loss: 0.6392 Validation Accuracy: 0.705800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.6209 Validation Accuracy: 0.648600 Epoch 28, CIFAR-10 Batch 1: Loss: 0.6094 Validation Accuracy: 0.527600 Epoch 28, CIFAR-10 Batch 2: Loss: 0.6471 Validation Accuracy: 0.551200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.6233 Validation Accuracy: 0.500200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.5955 Validation Accuracy: 0.676800 Epoch 28, CIFAR-10 Batch 5: Loss: 0.5639 Validation Accuracy: 0.686400 Epoch 29, CIFAR-10 Batch 1: Loss: 0.5748 Validation Accuracy: 0.704200 Epoch 29, CIFAR-10 Batch 2: Loss: 0.7857 Validation Accuracy: 0.669400 Epoch 29, CIFAR-10 Batch 3: Loss: 0.5279 Validation Accuracy: 0.582200 Epoch 29, CIFAR-10 Batch 4: Loss: 0.5904 Validation Accuracy: 0.640200 Epoch 29, CIFAR-10 Batch 5: Loss: 0.5353 Validation Accuracy: 0.610600 Epoch 30, CIFAR-10 Batch 1: Loss: 0.5315 Validation Accuracy: 0.659600 Epoch 30, CIFAR-10 Batch 2: Loss: 0.7359 Validation Accuracy: 0.432800 Epoch 30, CIFAR-10 Batch 3: Loss: 0.5812 Validation Accuracy: 0.584800 Epoch 30, CIFAR-10 Batch 4: Loss: 0.5712 Validation Accuracy: 0.615800 Epoch 30, CIFAR-10 Batch 5: Loss: 0.5724 Validation Accuracy: 0.639200 Epoch 31, CIFAR-10 Batch 1: Loss: 0.5128 Validation Accuracy: 0.652200 Epoch 31, CIFAR-10 Batch 2: Loss: 0.6421 Validation Accuracy: 0.641400 Epoch 31, CIFAR-10 Batch 3: Loss: 0.5663 Validation Accuracy: 0.594600 Epoch 31, CIFAR-10 Batch 4: Loss: 0.5985 Validation Accuracy: 0.679400 Epoch 31, CIFAR-10 Batch 5: Loss: 0.5904 Validation Accuracy: 0.682600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.5703 Validation Accuracy: 0.689600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.6779 Validation Accuracy: 0.664000 Epoch 32, CIFAR-10 Batch 3: Loss: 0.5328 Validation Accuracy: 0.640800 Epoch 32, CIFAR-10 Batch 4: Loss: 0.5385 Validation Accuracy: 0.668600 Epoch 32, CIFAR-10 Batch 5: Loss: 0.6230 Validation Accuracy: 0.627800 Epoch 33, CIFAR-10 Batch 1: Loss: 0.6483 Validation Accuracy: 0.523000 Epoch 33, CIFAR-10 Batch 2: Loss: 0.7332 Validation Accuracy: 0.615400 Epoch 33, CIFAR-10 Batch 3: Loss: 0.5327 Validation Accuracy: 0.514000 Epoch 33, CIFAR-10 Batch 4: Loss: 0.5790 Validation Accuracy: 0.566000 Epoch 33, CIFAR-10 Batch 5: Loss: 0.4944 Validation Accuracy: 0.623600 Epoch 34, CIFAR-10 Batch 1: Loss: 0.5409 Validation Accuracy: 0.691400 Epoch 34, CIFAR-10 Batch 2: Loss: 0.6375 Validation Accuracy: 0.600400 Epoch 34, CIFAR-10 Batch 3: Loss: 0.5669 Validation Accuracy: 0.582800 Epoch 34, CIFAR-10 Batch 4: Loss: 0.5472 Validation Accuracy: 0.669800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.5971 Validation Accuracy: 0.613400 Epoch 35, CIFAR-10 Batch 1: Loss: 0.5899 Validation Accuracy: 0.678600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.6618 Validation Accuracy: 0.575200 Epoch 35, CIFAR-10 Batch 3: Loss: 0.5549 Validation Accuracy: 0.690000 Epoch 35, CIFAR-10 Batch 4: Loss: 0.5838 Validation Accuracy: 0.714400 Epoch 35, CIFAR-10 Batch 5: Loss: 0.5951 Validation Accuracy: 0.656600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.4865 Validation Accuracy: 0.571000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.6480 Validation Accuracy: 0.665600 Epoch 36, CIFAR-10 Batch 3: Loss: 0.5763 Validation Accuracy: 0.552200 Epoch 36, CIFAR-10 Batch 4: Loss: 0.5382 Validation Accuracy: 0.686200 Epoch 36, CIFAR-10 Batch 5: Loss: 0.5402 Validation Accuracy: 0.649000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.5061 Validation Accuracy: 0.671800 Epoch 37, CIFAR-10 Batch 2: Loss: 0.6109 Validation Accuracy: 0.674000 Epoch 37, CIFAR-10 Batch 3: Loss: 0.5408 Validation Accuracy: 0.552000 Epoch 37, CIFAR-10 Batch 4: Loss: 0.5892 Validation Accuracy: 0.670600 Epoch 37, CIFAR-10 Batch 5: Loss: 0.5055 Validation Accuracy: 0.663600 Epoch 38, CIFAR-10 Batch 1: Loss: 0.5150 Validation Accuracy: 0.626200 Epoch 38, CIFAR-10 Batch 2: Loss: 0.6595 Validation Accuracy: 0.652400 Epoch 38, CIFAR-10 Batch 3: Loss: 0.4786 Validation Accuracy: 0.696800 Epoch 38, CIFAR-10 Batch 4: Loss: 0.5724 Validation Accuracy: 0.645800 Epoch 38, CIFAR-10 Batch 5: Loss: 0.5692 Validation Accuracy: 0.656200 Epoch 39, CIFAR-10 Batch 1: Loss: 0.5559 Validation Accuracy: 0.677000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.6540 Validation Accuracy: 0.319200 Epoch 39, CIFAR-10 Batch 3: Loss: 0.5220 Validation Accuracy: 0.613200 Epoch 39, CIFAR-10 Batch 4: Loss: 0.5737 Validation Accuracy: 0.707000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.5066 Validation Accuracy: 0.716600 Epoch 40, CIFAR-10 Batch 1: Loss: 0.6119 Validation Accuracy: 0.644600 Epoch 40, CIFAR-10 Batch 2: Loss: 0.6370 Validation Accuracy: 0.588200 Epoch 40, CIFAR-10 Batch 3: Loss: 0.5436 Validation Accuracy: 0.653800 Epoch 40, CIFAR-10 Batch 4: Loss: 0.5436 Validation Accuracy: 0.660200 Epoch 40, CIFAR-10 Batch 5: Loss: 0.4761 Validation Accuracy: 0.659200 Epoch 41, CIFAR-10 Batch 1: Loss: 0.5006 Validation Accuracy: 0.666400 Epoch 41, CIFAR-10 Batch 2: Loss: 0.6384 Validation Accuracy: 0.526400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.4698 Validation Accuracy: 0.646200 Epoch 41, CIFAR-10 Batch 4: Loss: 0.5862 Validation Accuracy: 0.703400 Epoch 41, CIFAR-10 Batch 5: Loss: 0.5541 Validation Accuracy: 0.668600 Epoch 42, CIFAR-10 Batch 1: Loss: 0.5316 Validation Accuracy: 0.593800 Epoch 42, CIFAR-10 Batch 2: Loss: 0.6578 Validation Accuracy: 0.694800 Epoch 42, CIFAR-10 Batch 3: Loss: 0.4924 Validation Accuracy: 0.660000 Epoch 42, CIFAR-10 Batch 4: Loss: 0.5257 Validation Accuracy: 0.665000 Epoch 42, CIFAR-10 Batch 5: Loss: 0.5190 Validation Accuracy: 0.637600 Epoch 43, CIFAR-10 Batch 1: Loss: 0.5268 Validation Accuracy: 0.546200 Epoch 43, CIFAR-10 Batch 2: Loss: 0.6440 Validation Accuracy: 0.515000 Epoch 43, CIFAR-10 Batch 3: Loss: 0.4476 Validation Accuracy: 0.673200 Epoch 43, CIFAR-10 Batch 4: Loss: 0.5675 Validation Accuracy: 0.571000 Epoch 43, CIFAR-10 Batch 5: Loss: 0.5935 Validation Accuracy: 0.650600 Epoch 44, CIFAR-10 Batch 1: Loss: 0.4968 Validation Accuracy: 0.599200 Epoch 44, CIFAR-10 Batch 2: Loss: 0.5210 Validation Accuracy: 0.632600 Epoch 44, CIFAR-10 Batch 3: Loss: 0.5289 Validation Accuracy: 0.636600 Epoch 44, CIFAR-10 Batch 4: Loss: 0.4943 Validation Accuracy: 0.699600 Epoch 44, CIFAR-10 Batch 5: Loss: 0.4455 Validation Accuracy: 0.612800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.5791 Validation Accuracy: 0.347600 Epoch 45, CIFAR-10 Batch 2: Loss: 0.5443 Validation Accuracy: 0.659400 Epoch 45, CIFAR-10 Batch 3: Loss: 0.4520 Validation Accuracy: 0.722800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.4826 Validation Accuracy: 0.725400 Epoch 45, CIFAR-10 Batch 5: Loss: 0.4780 Validation Accuracy: 0.706600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.4703 Validation Accuracy: 0.678200 Epoch 46, CIFAR-10 Batch 2: Loss: 0.6128 Validation Accuracy: 0.670000 Epoch 46, CIFAR-10 Batch 3: Loss: 0.5136 Validation Accuracy: 0.686800 Epoch 46, CIFAR-10 Batch 4: Loss: 0.5062 Validation Accuracy: 0.726600 Epoch 46, CIFAR-10 Batch 5: Loss: 0.4874 Validation Accuracy: 0.520200 Epoch 47, CIFAR-10 Batch 1: Loss: 0.4806 Validation Accuracy: 0.591000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.6280 Validation Accuracy: 0.636200 Epoch 47, CIFAR-10 Batch 3: Loss: 0.5184 Validation Accuracy: 0.667200 Epoch 47, CIFAR-10 Batch 4: Loss: 0.5295 Validation Accuracy: 0.681800 Epoch 47, CIFAR-10 Batch 5: Loss: 0.4337 Validation Accuracy: 0.730800 Epoch 48, CIFAR-10 Batch 1: Loss: 0.5267 Validation Accuracy: 0.653600 Epoch 48, CIFAR-10 Batch 2: Loss: 0.5299 Validation Accuracy: 0.694400 Epoch 48, CIFAR-10 Batch 3: Loss: 0.4230 Validation Accuracy: 0.697000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.5593 Validation Accuracy: 0.579600 Epoch 48, CIFAR-10 Batch 5: Loss: 0.4163 Validation Accuracy: 0.705200 Epoch 49, CIFAR-10 Batch 1: Loss: 0.4764 Validation Accuracy: 0.716600 Epoch 49, CIFAR-10 Batch 2: Loss: 0.5880 Validation Accuracy: 0.660000 Epoch 49, CIFAR-10 Batch 3: Loss: 0.4820 Validation Accuracy: 0.695200 Epoch 49, CIFAR-10 Batch 4: Loss: 0.4887 Validation Accuracy: 0.697400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.4691 Validation Accuracy: 0.658000 Epoch 50, CIFAR-10 Batch 1: Loss: 0.5104 Validation Accuracy: 0.629200 Epoch 50, CIFAR-10 Batch 2: Loss: 0.5646 Validation Accuracy: 0.674200 Epoch 50, CIFAR-10 Batch 3: Loss: 0.4437 Validation Accuracy: 0.714600 Epoch 50, CIFAR-10 Batch 4: Loss: 0.4812 Validation Accuracy: 0.728000 Epoch 50, CIFAR-10 Batch 5: Loss: 0.5176 Validation Accuracy: 0.640600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.5202 Validation Accuracy: 0.662400 Epoch 51, CIFAR-10 Batch 2: Loss: 0.5222 Validation Accuracy: 0.702400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.4524 Validation Accuracy: 0.604000 Epoch 51, CIFAR-10 Batch 4: Loss: 0.5236 Validation Accuracy: 0.579000 Epoch 51, CIFAR-10 Batch 5: Loss: 0.5096 Validation Accuracy: 0.630800 Epoch 52, CIFAR-10 Batch 1: Loss: 0.5553 Validation Accuracy: 0.648400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.5709 Validation Accuracy: 0.636400 Epoch 52, CIFAR-10 Batch 3: Loss: 0.3812 Validation Accuracy: 0.554000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.5417 Validation Accuracy: 0.643800 Epoch 52, CIFAR-10 Batch 5: Loss: 0.4821 Validation Accuracy: 0.700000 Epoch 53, CIFAR-10 Batch 1: Loss: 0.4778 Validation Accuracy: 0.723800 Epoch 53, CIFAR-10 Batch 2: Loss: 0.5600 Validation Accuracy: 0.748800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.4389 Validation Accuracy: 0.674200 Epoch 53, CIFAR-10 Batch 4: Loss: 0.5147 Validation Accuracy: 0.644800 Epoch 53, CIFAR-10 Batch 5: Loss: 0.4661 Validation Accuracy: 0.640000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.4928 Validation Accuracy: 0.571800 Epoch 54, CIFAR-10 Batch 2: Loss: 0.5801 Validation Accuracy: 0.536400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.4637 Validation Accuracy: 0.698200 Epoch 54, CIFAR-10 Batch 4: Loss: 0.5093 Validation Accuracy: 0.673600 Epoch 54, CIFAR-10 Batch 5: Loss: 0.3759 Validation Accuracy: 0.616200 Epoch 55, CIFAR-10 Batch 1: Loss: 0.4460 Validation Accuracy: 0.573200 Epoch 55, CIFAR-10 Batch 2: Loss: 0.5640 Validation Accuracy: 0.540800 Epoch 55, CIFAR-10 Batch 3: Loss: 0.4826 Validation Accuracy: 0.589800 Epoch 55, CIFAR-10 Batch 4: Loss: 0.5192 Validation Accuracy: 0.687000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.4250 Validation Accuracy: 0.724400 Epoch 56, CIFAR-10 Batch 1: Loss: 0.4858 Validation Accuracy: 0.606800 Epoch 56, CIFAR-10 Batch 2: Loss: 0.5413 Validation Accuracy: 0.729400 Epoch 56, CIFAR-10 Batch 3: Loss: 0.5219 Validation Accuracy: 0.741600 Epoch 56, CIFAR-10 Batch 4: Loss: 0.5303 Validation Accuracy: 0.669200 Epoch 56, CIFAR-10 Batch 5: Loss: 0.4881 Validation Accuracy: 0.543000 Epoch 57, CIFAR-10 Batch 1: Loss: 0.3906 Validation Accuracy: 0.621800 Epoch 57, CIFAR-10 Batch 2: Loss: 0.5467 Validation Accuracy: 0.637600 Epoch 57, CIFAR-10 Batch 3: Loss: 0.4152 Validation Accuracy: 0.675400 Epoch 57, CIFAR-10 Batch 4: Loss: 0.5488 Validation Accuracy: 0.669000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.4272 Validation Accuracy: 0.725600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.4494 Validation Accuracy: 0.693000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.4993 Validation Accuracy: 0.671800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.4445 Validation Accuracy: 0.698200 Epoch 58, CIFAR-10 Batch 4: Loss: 0.4821 Validation Accuracy: 0.605200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.3945 Validation Accuracy: 0.715200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.4698 Validation Accuracy: 0.722000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.5498 Validation Accuracy: 0.725200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.4134 Validation Accuracy: 0.702400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.4472 Validation Accuracy: 0.692600 Epoch 59, CIFAR-10 Batch 5: Loss: 0.3824 Validation Accuracy: 0.692800 Epoch 60, CIFAR-10 Batch 1: Loss: 0.4756 Validation Accuracy: 0.667200 Epoch 60, CIFAR-10 Batch 2: Loss: 0.4921 Validation Accuracy: 0.683400 Epoch 60, CIFAR-10 Batch 3: Loss: 0.4314 Validation Accuracy: 0.676200 Epoch 60, CIFAR-10 Batch 4: Loss: 0.5210 Validation Accuracy: 0.731600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.4565 Validation Accuracy: 0.708400 Epoch 61, CIFAR-10 Batch 1: Loss: 0.4120 Validation Accuracy: 0.732000 Epoch 61, CIFAR-10 Batch 2: Loss: 0.5283 Validation Accuracy: 0.655600 Epoch 61, CIFAR-10 Batch 3: Loss: 0.3897 Validation Accuracy: 0.692400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.5183 Validation Accuracy: 0.750400 Epoch 61, CIFAR-10 Batch 5: Loss: 0.4038 Validation Accuracy: 0.711200 Epoch 62, CIFAR-10 Batch 1: Loss: 0.4741 Validation Accuracy: 0.586000 Epoch 62, CIFAR-10 Batch 2: Loss: 0.5186 Validation Accuracy: 0.471200 Epoch 62, CIFAR-10 Batch 3: Loss: 0.4399 Validation Accuracy: 0.569600 Epoch 62, CIFAR-10 Batch 4: Loss: 0.5320 Validation Accuracy: 0.649800 Epoch 62, CIFAR-10 Batch 5: Loss: 0.4054 Validation Accuracy: 0.673600 Epoch 63, CIFAR-10 Batch 1: Loss: 0.4186 Validation Accuracy: 0.756800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.5540 Validation Accuracy: 0.726800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.4158 Validation Accuracy: 0.710800 Epoch 63, CIFAR-10 Batch 4: Loss: 0.5001 Validation Accuracy: 0.683200 Epoch 63, CIFAR-10 Batch 5: Loss: 0.4417 Validation Accuracy: 0.748800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.4405 Validation Accuracy: 0.671800 Epoch 64, CIFAR-10 Batch 2: Loss: 0.5303 Validation Accuracy: 0.633800 Epoch 64, CIFAR-10 Batch 3: Loss: 0.3621 Validation Accuracy: 0.663800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.5268 Validation Accuracy: 0.740600 Epoch 64, CIFAR-10 Batch 5: Loss: 0.4495 Validation Accuracy: 0.645800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.4694 Validation Accuracy: 0.663000 Epoch 65, CIFAR-10 Batch 2: Loss: 0.5083 Validation Accuracy: 0.727600 Epoch 65, CIFAR-10 Batch 3: Loss: 0.4124 Validation Accuracy: 0.724000 Epoch 65, CIFAR-10 Batch 4: Loss: 0.5319 Validation Accuracy: 0.629400 Epoch 65, CIFAR-10 Batch 5: Loss: 0.4348 Validation Accuracy: 0.728600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.4145 Validation Accuracy: 0.624800 Epoch 66, CIFAR-10 Batch 2: Loss: 0.5077 Validation Accuracy: 0.705200 Epoch 66, CIFAR-10 Batch 3: Loss: 0.4085 Validation Accuracy: 0.644800 Epoch 66, CIFAR-10 Batch 4: Loss: 0.5658 Validation Accuracy: 0.706000 Epoch 66, CIFAR-10 Batch 5: Loss: 0.4322 Validation Accuracy: 0.727800 Epoch 67, CIFAR-10 Batch 1: Loss: 0.4302 Validation Accuracy: 0.735200 Epoch 67, CIFAR-10 Batch 2: Loss: 0.4866 Validation Accuracy: 0.612200 Epoch 67, CIFAR-10 Batch 3: Loss: 0.3819 Validation Accuracy: 0.631000 Epoch 67, CIFAR-10 Batch 4: Loss: 0.4592 Validation Accuracy: 0.751600 Epoch 67, CIFAR-10 Batch 5: Loss: 0.4097 Validation Accuracy: 0.750200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.4271 Validation Accuracy: 0.571600 Epoch 68, CIFAR-10 Batch 2: Loss: 0.5005 Validation Accuracy: 0.664800 Epoch 68, CIFAR-10 Batch 3: Loss: 0.3903 Validation Accuracy: 0.722400 Epoch 68, CIFAR-10 Batch 4: Loss: 0.5217 Validation Accuracy: 0.643400 Epoch 68, CIFAR-10 Batch 5: Loss: 0.3988 Validation Accuracy: 0.696600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.4095 Validation Accuracy: 0.761600 Epoch 69, CIFAR-10 Batch 2: Loss: 0.5410 Validation Accuracy: 0.598000 Epoch 69, CIFAR-10 Batch 3: Loss: 0.4271 Validation Accuracy: 0.752800 Epoch 69, CIFAR-10 Batch 4: Loss: 0.5000 Validation Accuracy: 0.734200 Epoch 69, CIFAR-10 Batch 5: Loss: 0.5287 Validation Accuracy: 0.697000 Epoch 70, CIFAR-10 Batch 1: Loss: 0.4363 Validation Accuracy: 0.735000 Epoch 70, CIFAR-10 Batch 2: Loss: 0.4694 Validation Accuracy: 0.732400 Epoch 70, CIFAR-10 Batch 3: Loss: 0.4203 Validation Accuracy: 0.685400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.5228 Validation Accuracy: 0.662400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.4092 Validation Accuracy: 0.653800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.4481 Validation Accuracy: 0.525600 Epoch 71, CIFAR-10 Batch 2: Loss: 0.4723 Validation Accuracy: 0.554600 Epoch 71, CIFAR-10 Batch 3: Loss: 0.3998 Validation Accuracy: 0.690600 Epoch 71, CIFAR-10 Batch 4: Loss: 0.4877 Validation Accuracy: 0.690200 Epoch 71, CIFAR-10 Batch 5: Loss: 0.3851 Validation Accuracy: 0.583200 Epoch 72, CIFAR-10 Batch 1: Loss: 0.4012 Validation Accuracy: 0.699800 Epoch 72, CIFAR-10 Batch 2: Loss: 0.4952 Validation Accuracy: 0.648600 Epoch 72, CIFAR-10 Batch 3: Loss: 0.3927 Validation Accuracy: 0.716600 Epoch 72, CIFAR-10 Batch 4: Loss: 0.5216 Validation Accuracy: 0.635000 Epoch 72, CIFAR-10 Batch 5: Loss: 0.3806 Validation Accuracy: 0.618600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.3676 Validation Accuracy: 0.582600 Epoch 73, CIFAR-10 Batch 2: Loss: 0.5047 Validation Accuracy: 0.680600 Epoch 73, CIFAR-10 Batch 3: Loss: 0.4246 Validation Accuracy: 0.597200 Epoch 73, CIFAR-10 Batch 4: Loss: 0.4669 Validation Accuracy: 0.640400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.3693 Validation Accuracy: 0.626000 Epoch 74, CIFAR-10 Batch 1: Loss: 0.4151 Validation Accuracy: 0.706800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.4632 Validation Accuracy: 0.665600 Epoch 74, CIFAR-10 Batch 3: Loss: 0.3570 Validation Accuracy: 0.694400 Epoch 74, CIFAR-10 Batch 4: Loss: 0.5291 Validation Accuracy: 0.727200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.3938 Validation Accuracy: 0.676600 Epoch 75, CIFAR-10 Batch 1: Loss: 0.4122 Validation Accuracy: 0.560600 Epoch 75, CIFAR-10 Batch 2: Loss: 0.5388 Validation Accuracy: 0.695400 Epoch 75, CIFAR-10 Batch 3: Loss: 0.4334 Validation Accuracy: 0.632400 Epoch 75, CIFAR-10 Batch 4: Loss: 0.4896 Validation Accuracy: 0.578800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.4221 Validation Accuracy: 0.644800 Epoch 76, CIFAR-10 Batch 1: Loss: 0.3822 Validation Accuracy: 0.587800 Epoch 76, CIFAR-10 Batch 2: Loss: 0.5095 Validation Accuracy: 0.661400 Epoch 76, CIFAR-10 Batch 3: Loss: 0.3675 Validation Accuracy: 0.698600 Epoch 76, CIFAR-10 Batch 4: Loss: 0.4741 Validation Accuracy: 0.647400 Epoch 76, CIFAR-10 Batch 5: Loss: 0.4263 Validation Accuracy: 0.629200 Epoch 77, CIFAR-10 Batch 1: Loss: 0.4041 Validation Accuracy: 0.734400 Epoch 77, CIFAR-10 Batch 2: Loss: 0.4923 Validation Accuracy: 0.690000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.4301 Validation Accuracy: 0.652200 Epoch 77, CIFAR-10 Batch 4: Loss: 0.4890 Validation Accuracy: 0.731800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.3854 Validation Accuracy: 0.696600 Epoch 78, CIFAR-10 Batch 1: Loss: 0.4344 Validation Accuracy: 0.697600 Epoch 78, CIFAR-10 Batch 2: Loss: 0.5203 Validation Accuracy: 0.718400 Epoch 78, CIFAR-10 Batch 3: Loss: 0.4246 Validation Accuracy: 0.701600 Epoch 78, CIFAR-10 Batch 4: Loss: 0.4578 Validation Accuracy: 0.750000 Epoch 78, CIFAR-10 Batch 5: Loss: 0.3680 Validation Accuracy: 0.727400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.4307 Validation Accuracy: 0.614600 Epoch 79, CIFAR-10 Batch 2: Loss: 0.4797 Validation Accuracy: 0.573800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.3748 Validation Accuracy: 0.683200 Epoch 79, CIFAR-10 Batch 4: Loss: 0.4244 Validation Accuracy: 0.736800 Epoch 79, CIFAR-10 Batch 5: Loss: 0.3906 Validation Accuracy: 0.711600 Epoch 80, CIFAR-10 Batch 1: Loss: 0.4119 Validation Accuracy: 0.692200 Epoch 80, CIFAR-10 Batch 2: Loss: 0.4350 Validation Accuracy: 0.619400 Epoch 80, CIFAR-10 Batch 3: Loss: 0.4100 Validation Accuracy: 0.661400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.4753 Validation Accuracy: 0.724200 Epoch 80, CIFAR-10 Batch 5: Loss: 0.4375 Validation Accuracy: 0.748800 Epoch 81, CIFAR-10 Batch 1: Loss: 0.4623 Validation Accuracy: 0.728200 Epoch 81, CIFAR-10 Batch 2: Loss: 0.4657 Validation Accuracy: 0.728000 Epoch 81, CIFAR-10 Batch 3: Loss: 0.4435 Validation Accuracy: 0.679600 Epoch 81, CIFAR-10 Batch 4: Loss: 0.4948 Validation Accuracy: 0.704400 Epoch 81, CIFAR-10 Batch 5: Loss: 0.4817 Validation Accuracy: 0.720800 Epoch 82, CIFAR-10 Batch 1: Loss: 0.4232 Validation Accuracy: 0.797000 Epoch 82, CIFAR-10 Batch 2: Loss: 0.4095 Validation Accuracy: 0.804600 Epoch 82, CIFAR-10 Batch 3: Loss: 0.3123 Validation Accuracy: 0.819600 Epoch 82, CIFAR-10 Batch 4: Loss: 0.3510 Validation Accuracy: 0.790200 Epoch 82, CIFAR-10 Batch 5: Loss: 0.2888 Validation Accuracy: 0.815800 Epoch 83, CIFAR-10 Batch 1: Loss: 0.2997 Validation Accuracy: 0.824400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.2959 Validation Accuracy: 0.829600 Epoch 83, CIFAR-10 Batch 3: Loss: 0.2581 Validation Accuracy: 0.830200 Epoch 83, CIFAR-10 Batch 4: Loss: 0.3340 Validation Accuracy: 0.834400 Epoch 83, CIFAR-10 Batch 5: Loss: 0.2758 Validation Accuracy: 0.835600 Epoch 84, CIFAR-10 Batch 1: Loss: 0.2869 Validation Accuracy: 0.836000 Epoch 84, CIFAR-10 Batch 2: Loss: 0.2848 Validation Accuracy: 0.836400 Epoch 84, CIFAR-10 Batch 3: Loss: 0.2492 Validation Accuracy: 0.835800 Epoch 84, CIFAR-10 Batch 4: Loss: 0.3295 Validation Accuracy: 0.836800 Epoch 84, CIFAR-10 Batch 5: Loss: 0.2747 Validation Accuracy: 0.836200 Epoch 85, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835600 Epoch 85, CIFAR-10 Batch 2: Loss: 0.2838 Validation Accuracy: 0.835800 Epoch 85, CIFAR-10 Batch 3: Loss: 0.2486 Validation Accuracy: 0.836400 Epoch 85, CIFAR-10 Batch 4: Loss: 0.3290 Validation Accuracy: 0.836000 Epoch 85, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.835800 Epoch 86, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 86, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 86, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 86, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 86, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 87, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 87, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 87, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 87, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 88, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 88, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 88, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 88, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 88, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 89, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 89, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 90, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 90, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 90, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835600 Epoch 91, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 91, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 91, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 92, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 92, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 92, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 92, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 92, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 93, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 93, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 94, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 94, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 94, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 94, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 95, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 96, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 96, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 96, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 96, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 97, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836800 Epoch 97, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 97, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836000 Epoch 97, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 98, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 98, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 98, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 98, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 98, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.835800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 99, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 99, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 100, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 100, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 100, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 101, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 101, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 101, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 101, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 101, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 102, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 102, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 102, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 102, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 103, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 103, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 103, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836800 Epoch 104, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 104, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836800 Epoch 104, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 104, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 104, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 105, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 105, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 105, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 106, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 106, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 106, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 106, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 107, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 107, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 107, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 107, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 108, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 108, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 108, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 108, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 108, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 109, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 109, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 109, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 109, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.837000 Epoch 110, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 110, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835600 Epoch 110, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 110, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 110, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 111, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 111, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 111, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 111, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 112, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835600 Epoch 112, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 112, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 112, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 113, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 113, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 113, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 113, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 114, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 114, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 114, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 114, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 115, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 115, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 115, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 116, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 116, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 116, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 117, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 117, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 117, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 118, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 118, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 118, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 118, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 118, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 119, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 119, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 119, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 119, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 120, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835400 Epoch 120, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 120, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 121, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 121, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 121, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 122, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 122, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 122, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 122, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 123, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 123, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 123, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 123, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 124, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 124, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 124, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 124, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 124, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 125, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 125, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 125, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 125, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 126, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 126, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 126, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 126, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 126, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 127, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 127, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 127, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.835800 Epoch 127, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 128, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 128, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 128, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 128, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 129, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 129, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 129, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 129, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 129, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 130, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 130, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836800 Epoch 130, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 130, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 130, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 131, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 131, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 131, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 131, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 131, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 132, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 132, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 132, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 132, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 132, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 133, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 133, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 133, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 134, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 134, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 134, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 134, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 134, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 135, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 135, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835400 Epoch 135, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 135, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 135, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 136, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 136, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 137, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 138, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 138, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 138, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 139, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 139, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 139, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 139, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 140, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 140, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836600 Epoch 140, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 140, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 140, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 141, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 141, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 141, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 141, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 142, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 142, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 142, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 143, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836800 Epoch 143, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 144, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 144, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 144, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 144, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 144, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 145, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 145, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 145, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 145, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 146, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 146, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 146, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 146, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 147, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 147, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 147, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 147, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836000 Epoch 147, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 148, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 148, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 148, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 148, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 148, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 149, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 149, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 149, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 150, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 150, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 150, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 150, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836000 Epoch 150, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 151, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836600 Epoch 151, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836800 Epoch 151, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 151, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 152, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 152, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 152, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836000 Epoch 152, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 153, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 153, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 153, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 153, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 153, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 154, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836400 Epoch 154, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 154, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836800 Epoch 155, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 155, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836800 Epoch 155, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836600 Epoch 156, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 156, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 156, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 156, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 157, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 157, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836600 Epoch 157, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 158, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 158, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.835800 Epoch 158, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 158, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.835800 Epoch 159, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 159, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 159, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 159, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 160, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836000 Epoch 160, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 160, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 160, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Epoch 161, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 161, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836000 Epoch 161, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836600 Epoch 161, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.835800 Epoch 162, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836200 Epoch 162, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 162, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835800 Epoch 162, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836200 Epoch 163, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 163, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.835400 Epoch 163, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836400 Epoch 163, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.2858 Validation Accuracy: 0.836400 Epoch 164, CIFAR-10 Batch 2: Loss: 0.2837 Validation Accuracy: 0.836000 Epoch 164, CIFAR-10 Batch 3: Loss: 0.2485 Validation Accuracy: 0.836200 Epoch 164, CIFAR-10 Batch 4: Loss: 0.3289 Validation Accuracy: 0.836200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.2745 Validation Accuracy: 0.836000 Training for learning_rate=0.01000, batch_size=128 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.6020 Validation Accuracy: 0.197200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6521 Validation Accuracy: 0.211600 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3233 Validation Accuracy: 0.453200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.1431 Validation Accuracy: 0.391600 Epoch 1, CIFAR-10 Batch 5: Loss: 1.1910 Validation Accuracy: 0.324000 Epoch 2, CIFAR-10 Batch 1: Loss: 0.9184 Validation Accuracy: 0.274600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.1374 Validation Accuracy: 0.515200 Epoch 2, CIFAR-10 Batch 3: Loss: 1.1642 Validation Accuracy: 0.387800 Epoch 2, CIFAR-10 Batch 4: Loss: 0.9068 Validation Accuracy: 0.445600 Epoch 2, CIFAR-10 Batch 5: Loss: 0.9726 Validation Accuracy: 0.564600 Epoch 3, CIFAR-10 Batch 1: Loss: 0.7406 Validation Accuracy: 0.427600 Epoch 3, CIFAR-10 Batch 2: Loss: 0.8245 Validation Accuracy: 0.569000 Epoch 3, CIFAR-10 Batch 3: Loss: 0.9107 Validation Accuracy: 0.467400 Epoch 3, CIFAR-10 Batch 4: Loss: 0.7340 Validation Accuracy: 0.523600 Epoch 3, CIFAR-10 Batch 5: Loss: 0.7525 Validation Accuracy: 0.536800 Epoch 4, CIFAR-10 Batch 1: Loss: 0.7572 Validation Accuracy: 0.554400 Epoch 4, CIFAR-10 Batch 2: Loss: 0.8067 Validation Accuracy: 0.555000 Epoch 4, CIFAR-10 Batch 3: Loss: 0.6653 Validation Accuracy: 0.451800 Epoch 4, CIFAR-10 Batch 4: Loss: 0.6594 Validation Accuracy: 0.609600 Epoch 4, CIFAR-10 Batch 5: Loss: 0.6307 Validation Accuracy: 0.625400 Epoch 5, CIFAR-10 Batch 1: Loss: 0.6815 Validation Accuracy: 0.593600 Epoch 5, CIFAR-10 Batch 2: Loss: 0.6502 Validation Accuracy: 0.625000 Epoch 5, CIFAR-10 Batch 3: Loss: 0.7002 Validation Accuracy: 0.601600 Epoch 5, CIFAR-10 Batch 4: Loss: 0.6083 Validation Accuracy: 0.472200 Epoch 5, CIFAR-10 Batch 5: Loss: 0.5147 Validation Accuracy: 0.577600 Epoch 6, CIFAR-10 Batch 1: Loss: 0.5252 Validation Accuracy: 0.600000 Epoch 6, CIFAR-10 Batch 2: Loss: 0.5539 Validation Accuracy: 0.630200 Epoch 6, CIFAR-10 Batch 3: Loss: 0.5337 Validation Accuracy: 0.671600 Epoch 6, CIFAR-10 Batch 4: Loss: 0.4901 Validation Accuracy: 0.668200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.4871 Validation Accuracy: 0.658600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.4390 Validation Accuracy: 0.748600 Epoch 7, CIFAR-10 Batch 2: Loss: 0.4686 Validation Accuracy: 0.690400 Epoch 7, CIFAR-10 Batch 3: Loss: 0.4685 Validation Accuracy: 0.672800 Epoch 7, CIFAR-10 Batch 4: Loss: 0.5449 Validation Accuracy: 0.565600 Epoch 7, CIFAR-10 Batch 5: Loss: 0.4386 Validation Accuracy: 0.577400 Epoch 8, CIFAR-10 Batch 1: Loss: 0.4987 Validation Accuracy: 0.623800 Epoch 8, CIFAR-10 Batch 2: Loss: 0.4590 Validation Accuracy: 0.659400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.4536 Validation Accuracy: 0.728600 Epoch 8, CIFAR-10 Batch 4: Loss: 0.4412 Validation Accuracy: 0.677400 Epoch 8, CIFAR-10 Batch 5: Loss: 0.4477 Validation Accuracy: 0.725800 Epoch 9, CIFAR-10 Batch 1: Loss: 0.4291 Validation Accuracy: 0.718400 Epoch 9, CIFAR-10 Batch 2: Loss: 0.4128 Validation Accuracy: 0.691400 Epoch 9, CIFAR-10 Batch 3: Loss: 0.4120 Validation Accuracy: 0.633200 Epoch 9, CIFAR-10 Batch 4: Loss: 0.4815 Validation Accuracy: 0.747000 Epoch 9, CIFAR-10 Batch 5: Loss: 0.3834 Validation Accuracy: 0.587600 Epoch 10, CIFAR-10 Batch 1: Loss: 0.3861 Validation Accuracy: 0.642800 Epoch 10, CIFAR-10 Batch 2: Loss: 0.3781 Validation Accuracy: 0.707800 Epoch 10, CIFAR-10 Batch 3: Loss: 0.4292 Validation Accuracy: 0.712800 Epoch 10, CIFAR-10 Batch 4: Loss: 0.4148 Validation Accuracy: 0.776200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.3382 Validation Accuracy: 0.606200 Epoch 11, CIFAR-10 Batch 1: Loss: 0.3937 Validation Accuracy: 0.645600 Epoch 11, CIFAR-10 Batch 2: Loss: 0.3102 Validation Accuracy: 0.709400 Epoch 11, CIFAR-10 Batch 3: Loss: 0.3284 Validation Accuracy: 0.727400 Epoch 11, CIFAR-10 Batch 4: Loss: 0.3823 Validation Accuracy: 0.688200 Epoch 11, CIFAR-10 Batch 5: Loss: 0.3416 Validation Accuracy: 0.750400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.3087 Validation Accuracy: 0.715200 Epoch 12, CIFAR-10 Batch 2: Loss: 0.3420 Validation Accuracy: 0.709600 Epoch 12, CIFAR-10 Batch 3: Loss: 0.3348 Validation Accuracy: 0.780400 Epoch 12, CIFAR-10 Batch 4: Loss: 0.3669 Validation Accuracy: 0.684200 Epoch 12, CIFAR-10 Batch 5: Loss: 0.3080 Validation Accuracy: 0.620200 Epoch 13, CIFAR-10 Batch 1: Loss: 0.3245 Validation Accuracy: 0.662800 Epoch 13, CIFAR-10 Batch 2: Loss: 0.3390 Validation Accuracy: 0.584600 Epoch 13, CIFAR-10 Batch 3: Loss: 0.3169 Validation Accuracy: 0.724800 Epoch 13, CIFAR-10 Batch 4: Loss: 0.3321 Validation Accuracy: 0.785000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.2803 Validation Accuracy: 0.781400 Epoch 14, CIFAR-10 Batch 1: Loss: 0.3136 Validation Accuracy: 0.748200 Epoch 14, CIFAR-10 Batch 2: Loss: 0.3522 Validation Accuracy: 0.747600 Epoch 14, CIFAR-10 Batch 3: Loss: 0.2856 Validation Accuracy: 0.736800 Epoch 14, CIFAR-10 Batch 4: Loss: 0.3042 Validation Accuracy: 0.777000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.2738 Validation Accuracy: 0.753600 Epoch 15, CIFAR-10 Batch 1: Loss: 0.3130 Validation Accuracy: 0.753800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.2991 Validation Accuracy: 0.716800 Epoch 15, CIFAR-10 Batch 3: Loss: 0.3269 Validation Accuracy: 0.776400 Epoch 15, CIFAR-10 Batch 4: Loss: 0.3428 Validation Accuracy: 0.749600 Epoch 15, CIFAR-10 Batch 5: Loss: 0.2662 Validation Accuracy: 0.613800 Epoch 16, CIFAR-10 Batch 1: Loss: 0.3077 Validation Accuracy: 0.756000 Epoch 16, CIFAR-10 Batch 2: Loss: 0.2844 Validation Accuracy: 0.717400 Epoch 16, CIFAR-10 Batch 3: Loss: 0.2507 Validation Accuracy: 0.776200 Epoch 16, CIFAR-10 Batch 4: Loss: 0.2862 Validation Accuracy: 0.750400 Epoch 16, CIFAR-10 Batch 5: Loss: 0.2326 Validation Accuracy: 0.750000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.2681 Validation Accuracy: 0.774400 Epoch 17, CIFAR-10 Batch 2: Loss: 0.2732 Validation Accuracy: 0.737200 Epoch 17, CIFAR-10 Batch 3: Loss: 0.2561 Validation Accuracy: 0.757000 Epoch 17, CIFAR-10 Batch 4: Loss: 0.2960 Validation Accuracy: 0.720400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.2402 Validation Accuracy: 0.580000 Epoch 18, CIFAR-10 Batch 1: Loss: 0.2414 Validation Accuracy: 0.703000 Epoch 18, CIFAR-10 Batch 2: Loss: 0.2386 Validation Accuracy: 0.761200 Epoch 18, CIFAR-10 Batch 3: Loss: 0.2211 Validation Accuracy: 0.764600 Epoch 18, CIFAR-10 Batch 4: Loss: 0.2852 Validation Accuracy: 0.776800 Epoch 18, CIFAR-10 Batch 5: Loss: 0.2480 Validation Accuracy: 0.673000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.2297 Validation Accuracy: 0.758400 Epoch 19, CIFAR-10 Batch 2: Loss: 0.2603 Validation Accuracy: 0.788000 Epoch 19, CIFAR-10 Batch 3: Loss: 0.2272 Validation Accuracy: 0.800600 Epoch 19, CIFAR-10 Batch 4: Loss: 0.2271 Validation Accuracy: 0.748000 Epoch 19, CIFAR-10 Batch 5: Loss: 0.2088 Validation Accuracy: 0.748400 Epoch 20, CIFAR-10 Batch 1: Loss: 0.2155 Validation Accuracy: 0.736800 Epoch 20, CIFAR-10 Batch 2: Loss: 0.2702 Validation Accuracy: 0.757200 Epoch 20, CIFAR-10 Batch 3: Loss: 0.2309 Validation Accuracy: 0.767800 Epoch 20, CIFAR-10 Batch 4: Loss: 0.2562 Validation Accuracy: 0.813800 Epoch 20, CIFAR-10 Batch 5: Loss: 0.2136 Validation Accuracy: 0.739000 Epoch 21, CIFAR-10 Batch 1: Loss: 0.2074 Validation Accuracy: 0.711000 Epoch 21, CIFAR-10 Batch 2: Loss: 0.2407 Validation Accuracy: 0.791000 Epoch 21, CIFAR-10 Batch 3: Loss: 0.2230 Validation Accuracy: 0.726400 Epoch 21, CIFAR-10 Batch 4: Loss: 0.2839 Validation Accuracy: 0.780600 Epoch 21, CIFAR-10 Batch 5: Loss: 0.2196 Validation Accuracy: 0.658800 Epoch 22, CIFAR-10 Batch 1: Loss: 0.2210 Validation Accuracy: 0.770000 Epoch 22, CIFAR-10 Batch 2: Loss: 0.2544 Validation Accuracy: 0.792600 Epoch 22, CIFAR-10 Batch 3: Loss: 0.2252 Validation Accuracy: 0.712600 Epoch 22, CIFAR-10 Batch 4: Loss: 0.2346 Validation Accuracy: 0.745600 Epoch 22, CIFAR-10 Batch 5: Loss: 0.2114 Validation Accuracy: 0.831200 Epoch 23, CIFAR-10 Batch 1: Loss: 0.2272 Validation Accuracy: 0.670800 Epoch 23, CIFAR-10 Batch 2: Loss: 0.2154 Validation Accuracy: 0.768000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.2095 Validation Accuracy: 0.769800 Epoch 23, CIFAR-10 Batch 4: Loss: 0.2180 Validation Accuracy: 0.772600 Epoch 23, CIFAR-10 Batch 5: Loss: 0.2058 Validation Accuracy: 0.785800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.2090 Validation Accuracy: 0.762600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.2332 Validation Accuracy: 0.711000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.2105 Validation Accuracy: 0.727400 Epoch 24, CIFAR-10 Batch 4: Loss: 0.2384 Validation Accuracy: 0.837400 Epoch 24, CIFAR-10 Batch 5: Loss: 0.1965 Validation Accuracy: 0.797000 Epoch 25, CIFAR-10 Batch 1: Loss: 0.2034 Validation Accuracy: 0.766800 Epoch 25, CIFAR-10 Batch 2: Loss: 0.1995 Validation Accuracy: 0.721600 Epoch 25, CIFAR-10 Batch 3: Loss: 0.2177 Validation Accuracy: 0.796800 Epoch 25, CIFAR-10 Batch 4: Loss: 0.2227 Validation Accuracy: 0.796600 Epoch 25, CIFAR-10 Batch 5: Loss: 0.1766 Validation Accuracy: 0.806600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.1902 Validation Accuracy: 0.722600 Epoch 26, CIFAR-10 Batch 2: Loss: 0.2053 Validation Accuracy: 0.753600 Epoch 26, CIFAR-10 Batch 3: Loss: 0.1972 Validation Accuracy: 0.792200 Epoch 26, CIFAR-10 Batch 4: Loss: 0.2370 Validation Accuracy: 0.792400 Epoch 26, CIFAR-10 Batch 5: Loss: 0.1929 Validation Accuracy: 0.772400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.1885 Validation Accuracy: 0.809600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.2137 Validation Accuracy: 0.792000 Epoch 27, CIFAR-10 Batch 3: Loss: 0.2021 Validation Accuracy: 0.810800 Epoch 27, CIFAR-10 Batch 4: Loss: 0.2155 Validation Accuracy: 0.813400 Epoch 27, CIFAR-10 Batch 5: Loss: 0.1939 Validation Accuracy: 0.769000 Epoch 28, CIFAR-10 Batch 1: Loss: 0.1998 Validation Accuracy: 0.789000 Epoch 28, CIFAR-10 Batch 2: Loss: 0.1963 Validation Accuracy: 0.755800 Epoch 28, CIFAR-10 Batch 3: Loss: 0.2091 Validation Accuracy: 0.717200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.2243 Validation Accuracy: 0.788600 Epoch 28, CIFAR-10 Batch 5: Loss: 0.1952 Validation Accuracy: 0.735200 Epoch 29, CIFAR-10 Batch 1: Loss: 0.1993 Validation Accuracy: 0.779400 Epoch 29, CIFAR-10 Batch 2: Loss: 0.2031 Validation Accuracy: 0.795800 Epoch 29, CIFAR-10 Batch 3: Loss: 0.1911 Validation Accuracy: 0.748800 Epoch 29, CIFAR-10 Batch 4: Loss: 0.1952 Validation Accuracy: 0.804600 Epoch 29, CIFAR-10 Batch 5: Loss: 0.1863 Validation Accuracy: 0.615200 Epoch 30, CIFAR-10 Batch 1: Loss: 0.1893 Validation Accuracy: 0.630800 Epoch 30, CIFAR-10 Batch 2: Loss: 0.2014 Validation Accuracy: 0.797600 Epoch 30, CIFAR-10 Batch 3: Loss: 0.1985 Validation Accuracy: 0.790000 Epoch 30, CIFAR-10 Batch 4: Loss: 0.2144 Validation Accuracy: 0.824000 Epoch 30, CIFAR-10 Batch 5: Loss: 0.1930 Validation Accuracy: 0.774800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.1885 Validation Accuracy: 0.754200 Epoch 31, CIFAR-10 Batch 2: Loss: 0.1982 Validation Accuracy: 0.786400 Epoch 31, CIFAR-10 Batch 3: Loss: 0.1871 Validation Accuracy: 0.773200 Epoch 31, CIFAR-10 Batch 4: Loss: 0.2044 Validation Accuracy: 0.820800 Epoch 31, CIFAR-10 Batch 5: Loss: 0.1683 Validation Accuracy: 0.762400 Epoch 32, CIFAR-10 Batch 1: Loss: 0.1770 Validation Accuracy: 0.788600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.2094 Validation Accuracy: 0.754000 Epoch 32, CIFAR-10 Batch 3: Loss: 0.1885 Validation Accuracy: 0.810800 Epoch 32, CIFAR-10 Batch 4: Loss: 0.1972 Validation Accuracy: 0.838800 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1720 Validation Accuracy: 0.802400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.1805 Validation Accuracy: 0.798200 Epoch 33, CIFAR-10 Batch 2: Loss: 0.2012 Validation Accuracy: 0.736800 Epoch 33, CIFAR-10 Batch 3: Loss: 0.1850 Validation Accuracy: 0.818600 Epoch 33, CIFAR-10 Batch 4: Loss: 0.2004 Validation Accuracy: 0.806600 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1794 Validation Accuracy: 0.756400 Epoch 34, CIFAR-10 Batch 1: Loss: 0.1711 Validation Accuracy: 0.722200 Epoch 34, CIFAR-10 Batch 2: Loss: 0.2023 Validation Accuracy: 0.802200 Epoch 34, CIFAR-10 Batch 3: Loss: 0.2010 Validation Accuracy: 0.772200 Epoch 34, CIFAR-10 Batch 4: Loss: 0.1894 Validation Accuracy: 0.811200 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1676 Validation Accuracy: 0.763600 Epoch 35, CIFAR-10 Batch 1: Loss: 0.1861 Validation Accuracy: 0.766800 Epoch 35, CIFAR-10 Batch 2: Loss: 0.1935 Validation Accuracy: 0.794000 Epoch 35, CIFAR-10 Batch 3: Loss: 0.1815 Validation Accuracy: 0.749000 Epoch 35, CIFAR-10 Batch 4: Loss: 0.1922 Validation Accuracy: 0.801000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1766 Validation Accuracy: 0.781600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.1880 Validation Accuracy: 0.796000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.1842 Validation Accuracy: 0.798200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.1814 Validation Accuracy: 0.817600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.1980 Validation Accuracy: 0.823600 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1728 Validation Accuracy: 0.797800 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1866 Validation Accuracy: 0.822400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.2067 Validation Accuracy: 0.776600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.1854 Validation Accuracy: 0.827200 Epoch 37, CIFAR-10 Batch 4: Loss: 0.2002 Validation Accuracy: 0.783800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1712 Validation Accuracy: 0.818000 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1763 Validation Accuracy: 0.738800 Epoch 38, CIFAR-10 Batch 2: Loss: 0.1991 Validation Accuracy: 0.771600 Epoch 38, CIFAR-10 Batch 3: Loss: 0.1826 Validation Accuracy: 0.805600 Epoch 38, CIFAR-10 Batch 4: Loss: 0.1937 Validation Accuracy: 0.809000 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1741 Validation Accuracy: 0.832800 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1861 Validation Accuracy: 0.788400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.1862 Validation Accuracy: 0.707000 Epoch 39, CIFAR-10 Batch 3: Loss: 0.1814 Validation Accuracy: 0.819200 Epoch 39, CIFAR-10 Batch 4: Loss: 0.1777 Validation Accuracy: 0.813200 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1817 Validation Accuracy: 0.816000 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1796 Validation Accuracy: 0.826200 Epoch 40, CIFAR-10 Batch 2: Loss: 0.1906 Validation Accuracy: 0.792200 Epoch 40, CIFAR-10 Batch 3: Loss: 0.2079 Validation Accuracy: 0.794400 Epoch 40, CIFAR-10 Batch 4: Loss: 0.1832 Validation Accuracy: 0.791400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1783 Validation Accuracy: 0.814600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1719 Validation Accuracy: 0.815000 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1818 Validation Accuracy: 0.758800 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1896 Validation Accuracy: 0.797400 Epoch 41, CIFAR-10 Batch 4: Loss: 0.1916 Validation Accuracy: 0.835800 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1724 Validation Accuracy: 0.809200 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1752 Validation Accuracy: 0.774200 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1776 Validation Accuracy: 0.778000 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1698 Validation Accuracy: 0.823200 Epoch 42, CIFAR-10 Batch 4: Loss: 0.1838 Validation Accuracy: 0.797600 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1830 Validation Accuracy: 0.797600 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1735 Validation Accuracy: 0.806200 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1876 Validation Accuracy: 0.807000 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1755 Validation Accuracy: 0.841800 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1810 Validation Accuracy: 0.808000 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1746 Validation Accuracy: 0.768400 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1686 Validation Accuracy: 0.784600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1841 Validation Accuracy: 0.811400 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1724 Validation Accuracy: 0.837200 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1733 Validation Accuracy: 0.849000 Epoch 44, CIFAR-10 Batch 5: Loss: 0.1699 Validation Accuracy: 0.747000 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1752 Validation Accuracy: 0.795600 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1796 Validation Accuracy: 0.836400 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1677 Validation Accuracy: 0.833800 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1912 Validation Accuracy: 0.835000 Epoch 45, CIFAR-10 Batch 5: Loss: 0.1710 Validation Accuracy: 0.812200 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1791 Validation Accuracy: 0.782200 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1844 Validation Accuracy: 0.787800 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1677 Validation Accuracy: 0.804200 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1726 Validation Accuracy: 0.838000 Epoch 46, CIFAR-10 Batch 5: Loss: 0.1675 Validation Accuracy: 0.821200 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1786 Validation Accuracy: 0.807400 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1769 Validation Accuracy: 0.803600 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1753 Validation Accuracy: 0.798200 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1796 Validation Accuracy: 0.808200 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1747 Validation Accuracy: 0.799200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1710 Validation Accuracy: 0.804400 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1700 Validation Accuracy: 0.838200 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1698 Validation Accuracy: 0.772000 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1719 Validation Accuracy: 0.824800 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1647 Validation Accuracy: 0.796200 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1737 Validation Accuracy: 0.807800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1819 Validation Accuracy: 0.804800 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1735 Validation Accuracy: 0.816800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1938 Validation Accuracy: 0.835200 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1813 Validation Accuracy: 0.790600 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1778 Validation Accuracy: 0.801800 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1739 Validation Accuracy: 0.781200 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1768 Validation Accuracy: 0.847200 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1709 Validation Accuracy: 0.795600 Epoch 50, CIFAR-10 Batch 5: Loss: 0.1682 Validation Accuracy: 0.817000 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1792 Validation Accuracy: 0.752600 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1713 Validation Accuracy: 0.802000 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1786 Validation Accuracy: 0.780200 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1716 Validation Accuracy: 0.830800 Epoch 51, CIFAR-10 Batch 5: Loss: 0.1649 Validation Accuracy: 0.826400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1649 Validation Accuracy: 0.765600 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1796 Validation Accuracy: 0.832000 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1730 Validation Accuracy: 0.789000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1706 Validation Accuracy: 0.773400 Epoch 52, CIFAR-10 Batch 5: Loss: 0.1675 Validation Accuracy: 0.802600 Epoch 53, CIFAR-10 Batch 1: Loss: 0.1707 Validation Accuracy: 0.814800 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1794 Validation Accuracy: 0.800400 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1729 Validation Accuracy: 0.837400 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1746 Validation Accuracy: 0.814400 Epoch 53, CIFAR-10 Batch 5: Loss: 0.1638 Validation Accuracy: 0.798400 Epoch 54, CIFAR-10 Batch 1: Loss: 0.1652 Validation Accuracy: 0.821400 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1714 Validation Accuracy: 0.833400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1719 Validation Accuracy: 0.818200 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1790 Validation Accuracy: 0.823200 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1687 Validation Accuracy: 0.800200 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1728 Validation Accuracy: 0.838200 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1780 Validation Accuracy: 0.729200 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1765 Validation Accuracy: 0.833000 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1753 Validation Accuracy: 0.845200 Epoch 55, CIFAR-10 Batch 5: Loss: 0.1663 Validation Accuracy: 0.826000 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1688 Validation Accuracy: 0.674200 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1744 Validation Accuracy: 0.802800 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1701 Validation Accuracy: 0.823000 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1699 Validation Accuracy: 0.839200 Epoch 56, CIFAR-10 Batch 5: Loss: 0.1653 Validation Accuracy: 0.819200 Epoch 57, CIFAR-10 Batch 1: Loss: 0.1662 Validation Accuracy: 0.838000 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1676 Validation Accuracy: 0.814400 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1846 Validation Accuracy: 0.845200 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1742 Validation Accuracy: 0.812600 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1662 Validation Accuracy: 0.835200 Epoch 58, CIFAR-10 Batch 1: Loss: 0.1675 Validation Accuracy: 0.799200 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1721 Validation Accuracy: 0.748000 Epoch 58, CIFAR-10 Batch 3: Loss: 0.1738 Validation Accuracy: 0.802800 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1744 Validation Accuracy: 0.827200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1673 Validation Accuracy: 0.839800 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1658 Validation Accuracy: 0.823600 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1890 Validation Accuracy: 0.821200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1779 Validation Accuracy: 0.826400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1729 Validation Accuracy: 0.840200 Epoch 59, CIFAR-10 Batch 5: Loss: 0.1650 Validation Accuracy: 0.799200 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1709 Validation Accuracy: 0.814600 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1752 Validation Accuracy: 0.760000 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1698 Validation Accuracy: 0.836200 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1720 Validation Accuracy: 0.815600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1681 Validation Accuracy: 0.797200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.1673 Validation Accuracy: 0.819000 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1743 Validation Accuracy: 0.797000 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1694 Validation Accuracy: 0.816800 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1685 Validation Accuracy: 0.833200 Epoch 61, CIFAR-10 Batch 5: Loss: 0.1658 Validation Accuracy: 0.823400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1734 Validation Accuracy: 0.807000 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1755 Validation Accuracy: 0.790000 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1731 Validation Accuracy: 0.823800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1681 Validation Accuracy: 0.816000 Epoch 62, CIFAR-10 Batch 5: Loss: 0.1639 Validation Accuracy: 0.851200 Epoch 63, CIFAR-10 Batch 1: Loss: 0.1928 Validation Accuracy: 0.765600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1674 Validation Accuracy: 0.786000 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1651 Validation Accuracy: 0.822400 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1875 Validation Accuracy: 0.801600 Epoch 63, CIFAR-10 Batch 5: Loss: 0.1686 Validation Accuracy: 0.800000 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1686 Validation Accuracy: 0.819400 Epoch 64, CIFAR-10 Batch 2: Loss: 0.1703 Validation Accuracy: 0.827600 Epoch 64, CIFAR-10 Batch 3: Loss: 0.1685 Validation Accuracy: 0.823800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.1780 Validation Accuracy: 0.835000 Epoch 64, CIFAR-10 Batch 5: Loss: 0.1621 Validation Accuracy: 0.819600 Epoch 65, CIFAR-10 Batch 1: Loss: 0.1692 Validation Accuracy: 0.811000 Epoch 65, CIFAR-10 Batch 2: Loss: 0.1654 Validation Accuracy: 0.749200 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1659 Validation Accuracy: 0.815800 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1727 Validation Accuracy: 0.791000 Epoch 65, CIFAR-10 Batch 5: Loss: 0.1645 Validation Accuracy: 0.805200 Epoch 66, CIFAR-10 Batch 1: Loss: 0.1641 Validation Accuracy: 0.823400 Epoch 66, CIFAR-10 Batch 2: Loss: 0.1686 Validation Accuracy: 0.819000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.1664 Validation Accuracy: 0.816400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1762 Validation Accuracy: 0.817200 Epoch 66, CIFAR-10 Batch 5: Loss: 0.1671 Validation Accuracy: 0.816000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1599 Validation Accuracy: 0.800000 Epoch 67, CIFAR-10 Batch 2: Loss: 0.1730 Validation Accuracy: 0.756800 Epoch 67, CIFAR-10 Batch 3: Loss: 0.1695 Validation Accuracy: 0.815200 Epoch 67, CIFAR-10 Batch 4: Loss: 0.1700 Validation Accuracy: 0.836800 Epoch 67, CIFAR-10 Batch 5: Loss: 0.1633 Validation Accuracy: 0.821600 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1618 Validation Accuracy: 0.723000 Epoch 68, CIFAR-10 Batch 2: Loss: 0.1655 Validation Accuracy: 0.806400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1649 Validation Accuracy: 0.791400 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1666 Validation Accuracy: 0.818200 Epoch 68, CIFAR-10 Batch 5: Loss: 0.1626 Validation Accuracy: 0.805600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.1624 Validation Accuracy: 0.799200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.1657 Validation Accuracy: 0.816400 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1640 Validation Accuracy: 0.811600 Epoch 69, CIFAR-10 Batch 4: Loss: 0.1649 Validation Accuracy: 0.782000 Epoch 69, CIFAR-10 Batch 5: Loss: 0.1646 Validation Accuracy: 0.831800 Epoch 70, CIFAR-10 Batch 1: Loss: 0.1624 Validation Accuracy: 0.832400 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1655 Validation Accuracy: 0.839000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1622 Validation Accuracy: 0.830200 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1710 Validation Accuracy: 0.820000 Epoch 70, CIFAR-10 Batch 5: Loss: 0.1630 Validation Accuracy: 0.836400 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1646 Validation Accuracy: 0.803800 Epoch 71, CIFAR-10 Batch 2: Loss: 0.1692 Validation Accuracy: 0.837600 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1635 Validation Accuracy: 0.834600 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1698 Validation Accuracy: 0.832800 Epoch 71, CIFAR-10 Batch 5: Loss: 0.1641 Validation Accuracy: 0.786800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.1626 Validation Accuracy: 0.800400 Epoch 72, CIFAR-10 Batch 2: Loss: 0.1772 Validation Accuracy: 0.793600 Epoch 72, CIFAR-10 Batch 3: Loss: 0.1659 Validation Accuracy: 0.854600 Epoch 72, CIFAR-10 Batch 4: Loss: 0.1695 Validation Accuracy: 0.791400 Epoch 72, CIFAR-10 Batch 5: Loss: 0.1639 Validation Accuracy: 0.768400 Epoch 73, CIFAR-10 Batch 1: Loss: 0.1598 Validation Accuracy: 0.812400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.1769 Validation Accuracy: 0.774400 Epoch 73, CIFAR-10 Batch 3: Loss: 0.1653 Validation Accuracy: 0.761400 Epoch 73, CIFAR-10 Batch 4: Loss: 0.1719 Validation Accuracy: 0.835600 Epoch 73, CIFAR-10 Batch 5: Loss: 0.1647 Validation Accuracy: 0.839200 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1628 Validation Accuracy: 0.796200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1789 Validation Accuracy: 0.820200 Epoch 74, CIFAR-10 Batch 3: Loss: 0.2263 Validation Accuracy: 0.795200 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1703 Validation Accuracy: 0.810800 Epoch 74, CIFAR-10 Batch 5: Loss: 0.1704 Validation Accuracy: 0.830600 Epoch 75, CIFAR-10 Batch 1: Loss: 0.1626 Validation Accuracy: 0.839800 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1674 Validation Accuracy: 0.824600 Epoch 75, CIFAR-10 Batch 3: Loss: 0.1641 Validation Accuracy: 0.768400 Epoch 75, CIFAR-10 Batch 4: Loss: 0.1679 Validation Accuracy: 0.827800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.1625 Validation Accuracy: 0.812000 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1660 Validation Accuracy: 0.806400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1761 Validation Accuracy: 0.806200 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1669 Validation Accuracy: 0.837800 Epoch 76, CIFAR-10 Batch 4: Loss: 0.1657 Validation Accuracy: 0.839000 Epoch 76, CIFAR-10 Batch 5: Loss: 0.1691 Validation Accuracy: 0.842800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.1609 Validation Accuracy: 0.810600 Epoch 77, CIFAR-10 Batch 2: Loss: 0.1663 Validation Accuracy: 0.772000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.1617 Validation Accuracy: 0.828400 Epoch 77, CIFAR-10 Batch 4: Loss: 0.1631 Validation Accuracy: 0.842600 Epoch 77, CIFAR-10 Batch 5: Loss: 0.1623 Validation Accuracy: 0.815400 Epoch 78, CIFAR-10 Batch 1: Loss: 0.1635 Validation Accuracy: 0.783400 Epoch 78, CIFAR-10 Batch 2: Loss: 0.1709 Validation Accuracy: 0.819000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.1628 Validation Accuracy: 0.810200 Epoch 78, CIFAR-10 Batch 4: Loss: 0.1669 Validation Accuracy: 0.794800 Epoch 78, CIFAR-10 Batch 5: Loss: 0.1639 Validation Accuracy: 0.808400 Epoch 79, CIFAR-10 Batch 1: Loss: 0.1632 Validation Accuracy: 0.848200 Epoch 79, CIFAR-10 Batch 2: Loss: 0.1650 Validation Accuracy: 0.825200 Epoch 79, CIFAR-10 Batch 3: Loss: 0.1646 Validation Accuracy: 0.778200 Epoch 79, CIFAR-10 Batch 4: Loss: 0.1640 Validation Accuracy: 0.815400 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1639 Validation Accuracy: 0.837200 Epoch 80, CIFAR-10 Batch 1: Loss: 0.1668 Validation Accuracy: 0.846200 Epoch 80, CIFAR-10 Batch 2: Loss: 0.1771 Validation Accuracy: 0.836000 Epoch 80, CIFAR-10 Batch 3: Loss: 0.1624 Validation Accuracy: 0.851200 Epoch 80, CIFAR-10 Batch 4: Loss: 0.1657 Validation Accuracy: 0.827800 Epoch 80, CIFAR-10 Batch 5: Loss: 0.1605 Validation Accuracy: 0.835000 Epoch 81, CIFAR-10 Batch 1: Loss: 0.1691 Validation Accuracy: 0.838400 Epoch 81, CIFAR-10 Batch 2: Loss: 0.1633 Validation Accuracy: 0.828600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.1617 Validation Accuracy: 0.817200 Epoch 81, CIFAR-10 Batch 4: Loss: 0.1622 Validation Accuracy: 0.838200 Epoch 81, CIFAR-10 Batch 5: Loss: 0.1599 Validation Accuracy: 0.791000 Epoch 82, CIFAR-10 Batch 1: Loss: 0.1667 Validation Accuracy: 0.878600 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1604 Validation Accuracy: 0.888400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.1525 Validation Accuracy: 0.887200 Epoch 82, CIFAR-10 Batch 4: Loss: 0.1496 Validation Accuracy: 0.882800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.1454 Validation Accuracy: 0.889400 Epoch 83, CIFAR-10 Batch 1: Loss: 0.1462 Validation Accuracy: 0.889800 Epoch 83, CIFAR-10 Batch 2: Loss: 0.1489 Validation Accuracy: 0.890200 Epoch 83, CIFAR-10 Batch 3: Loss: 0.1457 Validation Accuracy: 0.891800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.1456 Validation Accuracy: 0.891000 Epoch 83, CIFAR-10 Batch 5: Loss: 0.1439 Validation Accuracy: 0.890800 Epoch 84, CIFAR-10 Batch 1: Loss: 0.1449 Validation Accuracy: 0.891400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.1476 Validation Accuracy: 0.891200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.1449 Validation Accuracy: 0.890800 Epoch 84, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.892000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 85, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 85, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 85, CIFAR-10 Batch 3: Loss: 0.1449 Validation Accuracy: 0.890800 Epoch 85, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 85, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 86, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 86, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 86, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 86, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 87, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 87, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 87, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 87, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 88, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 88, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 88, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 88, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 89, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.890800 Epoch 89, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 89, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 89, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 90, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 90, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 91, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 91, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 91, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 91, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 91, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891800 Epoch 92, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 92, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 92, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 92, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 93, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 93, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 93, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 93, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 94, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 94, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 94, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 94, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.892000 Epoch 95, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 95, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 95, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 95, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 95, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 96, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 96, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 96, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 96, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 97, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 97, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 97, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 97, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 97, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 98, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 98, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 98, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 98, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 98, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 99, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 99, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 99, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 100, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 100, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 100, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 100, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 100, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 101, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 101, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 101, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 101, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 102, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 102, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 102, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 102, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 102, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 103, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 103, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 103, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 103, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 104, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 104, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.890600 Epoch 104, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 104, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 105, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 106, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 106, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.892000 Epoch 106, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 107, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 107, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891800 Epoch 108, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 108, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 108, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 108, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 109, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 109, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 109, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 110, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 110, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 110, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 110, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 110, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 111, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 111, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 111, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 111, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 112, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 112, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 112, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 113, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 113, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 113, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 113, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 113, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 114, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 114, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 114, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 114, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 115, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 115, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 115, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 115, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 115, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 116, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 116, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 117, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 117, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 117, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.892000 Epoch 118, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 118, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 118, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 118, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 118, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 119, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 119, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 119, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.892000 Epoch 119, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 120, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 120, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 120, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 120, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 120, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 121, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 121, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 122, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 122, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 122, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 122, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 122, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 123, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 123, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 123, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 123, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 123, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 124, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 124, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 124, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 124, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 124, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 125, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 125, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 125, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 126, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 126, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 126, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 126, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 127, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 127, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 127, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 127, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 127, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 128, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 128, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 128, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 129, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 129, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 129, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 129, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 129, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 130, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 130, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 130, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 130, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 131, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 131, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 131, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 132, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 132, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 132, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 132, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 133, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 133, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 133, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890800 Epoch 133, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891800 Epoch 133, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 134, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 134, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 134, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 134, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 135, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 135, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 135, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 135, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 136, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 136, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.890800 Epoch 136, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 136, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 137, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 137, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 137, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 137, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 138, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 138, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 138, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 138, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 138, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 139, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 139, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 139, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 139, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 139, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 140, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 140, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 140, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 140, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 141, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 141, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 141, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 142, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 142, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 142, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 142, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 143, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 143, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 143, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 143, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 144, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 144, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 144, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 144, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 144, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 145, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 145, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 145, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 145, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 146, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 146, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 146, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 146, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 147, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 147, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 147, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 147, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 147, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 148, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 148, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 148, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 148, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891800 Epoch 149, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 149, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 149, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 150, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 150, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 150, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 150, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 151, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 151, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891000 Epoch 151, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 152, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 152, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 152, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 152, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 153, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 153, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 153, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 153, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891600 Epoch 154, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 154, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 155, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 155, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 155, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 155, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890600 Epoch 156, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 156, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 156, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 156, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 156, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 157, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891000 Epoch 157, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 157, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 157, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891000 Epoch 158, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 158, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 158, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 158, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 158, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891800 Epoch 159, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 159, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891600 Epoch 160, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891600 Epoch 160, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 160, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 160, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.890800 Epoch 161, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 161, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 161, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891600 Epoch 161, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.892000 Epoch 162, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 162, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891000 Epoch 162, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 162, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 162, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Epoch 163, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891400 Epoch 163, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890600 Epoch 163, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891400 Epoch 163, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.1448 Validation Accuracy: 0.891200 Epoch 164, CIFAR-10 Batch 2: Loss: 0.1475 Validation Accuracy: 0.891400 Epoch 164, CIFAR-10 Batch 3: Loss: 0.1448 Validation Accuracy: 0.890400 Epoch 164, CIFAR-10 Batch 4: Loss: 0.1451 Validation Accuracy: 0.891200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.1437 Validation Accuracy: 0.891400 Training for learning_rate=0.00100, batch_size=128 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.6241 Validation Accuracy: 0.244600 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6062 Validation Accuracy: 0.253400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3341 Validation Accuracy: 0.389000 Epoch 1, CIFAR-10 Batch 4: Loss: 1.2113 Validation Accuracy: 0.539000 Epoch 1, CIFAR-10 Batch 5: Loss: 1.2306 Validation Accuracy: 0.485400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.0453 Validation Accuracy: 0.444800 Epoch 2, CIFAR-10 Batch 2: Loss: 1.1919 Validation Accuracy: 0.636400 Epoch 2, CIFAR-10 Batch 3: Loss: 0.8890 Validation Accuracy: 0.616800 Epoch 2, CIFAR-10 Batch 4: Loss: 0.9030 Validation Accuracy: 0.604600 Epoch 2, CIFAR-10 Batch 5: Loss: 0.8371 Validation Accuracy: 0.588400 Epoch 3, CIFAR-10 Batch 1: Loss: 0.7838 Validation Accuracy: 0.543400 Epoch 3, CIFAR-10 Batch 2: Loss: 0.9305 Validation Accuracy: 0.704800 Epoch 3, CIFAR-10 Batch 3: Loss: 0.6396 Validation Accuracy: 0.673000 Epoch 3, CIFAR-10 Batch 4: Loss: 0.6687 Validation Accuracy: 0.686800 Epoch 3, CIFAR-10 Batch 5: Loss: 0.6130 Validation Accuracy: 0.689600 Epoch 4, CIFAR-10 Batch 1: Loss: 0.6355 Validation Accuracy: 0.651800 Epoch 4, CIFAR-10 Batch 2: Loss: 0.6554 Validation Accuracy: 0.711400 Epoch 4, CIFAR-10 Batch 3: Loss: 0.4966 Validation Accuracy: 0.709000 Epoch 4, CIFAR-10 Batch 4: Loss: 0.5379 Validation Accuracy: 0.704200 Epoch 4, CIFAR-10 Batch 5: Loss: 0.4544 Validation Accuracy: 0.656000 Epoch 5, CIFAR-10 Batch 1: Loss: 0.4709 Validation Accuracy: 0.695200 Epoch 5, CIFAR-10 Batch 2: Loss: 0.5554 Validation Accuracy: 0.698200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.4398 Validation Accuracy: 0.740600 Epoch 5, CIFAR-10 Batch 4: Loss: 0.4755 Validation Accuracy: 0.703600 Epoch 5, CIFAR-10 Batch 5: Loss: 0.3718 Validation Accuracy: 0.722800 Epoch 6, CIFAR-10 Batch 1: Loss: 0.3840 Validation Accuracy: 0.736800 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4693 Validation Accuracy: 0.740000 Epoch 6, CIFAR-10 Batch 3: Loss: 0.3573 Validation Accuracy: 0.636800 Epoch 6, CIFAR-10 Batch 4: Loss: 0.4221 Validation Accuracy: 0.772200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.2811 Validation Accuracy: 0.762600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.3155 Validation Accuracy: 0.744800 Epoch 7, CIFAR-10 Batch 2: Loss: 0.3496 Validation Accuracy: 0.745800 Epoch 7, CIFAR-10 Batch 3: Loss: 0.3242 Validation Accuracy: 0.764200 Epoch 7, CIFAR-10 Batch 4: Loss: 0.3710 Validation Accuracy: 0.778600 Epoch 7, CIFAR-10 Batch 5: Loss: 0.2307 Validation Accuracy: 0.708400 Epoch 8, CIFAR-10 Batch 1: Loss: 0.2622 Validation Accuracy: 0.769400 Epoch 8, CIFAR-10 Batch 2: Loss: 0.3143 Validation Accuracy: 0.725400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.2919 Validation Accuracy: 0.762200 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3308 Validation Accuracy: 0.748600 Epoch 8, CIFAR-10 Batch 5: Loss: 0.1970 Validation Accuracy: 0.798000 Epoch 9, CIFAR-10 Batch 1: Loss: 0.2284 Validation Accuracy: 0.802800 Epoch 9, CIFAR-10 Batch 2: Loss: 0.2338 Validation Accuracy: 0.745000 Epoch 9, CIFAR-10 Batch 3: Loss: 0.2448 Validation Accuracy: 0.749000 Epoch 9, CIFAR-10 Batch 4: Loss: 0.2788 Validation Accuracy: 0.760200 Epoch 9, CIFAR-10 Batch 5: Loss: 0.1664 Validation Accuracy: 0.813600 Epoch 10, CIFAR-10 Batch 1: Loss: 0.1666 Validation Accuracy: 0.674800 Epoch 10, CIFAR-10 Batch 2: Loss: 0.1965 Validation Accuracy: 0.773800 Epoch 10, CIFAR-10 Batch 3: Loss: 0.2298 Validation Accuracy: 0.780600 Epoch 10, CIFAR-10 Batch 4: Loss: 0.2517 Validation Accuracy: 0.772800 Epoch 10, CIFAR-10 Batch 5: Loss: 0.1142 Validation Accuracy: 0.808200 Epoch 11, CIFAR-10 Batch 1: Loss: 0.1686 Validation Accuracy: 0.785200 Epoch 11, CIFAR-10 Batch 2: Loss: 0.1779 Validation Accuracy: 0.751000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.2045 Validation Accuracy: 0.811600 Epoch 11, CIFAR-10 Batch 4: Loss: 0.2121 Validation Accuracy: 0.743000 Epoch 11, CIFAR-10 Batch 5: Loss: 0.1112 Validation Accuracy: 0.796400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.1583 Validation Accuracy: 0.800600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.1509 Validation Accuracy: 0.750600 Epoch 12, CIFAR-10 Batch 3: Loss: 0.1536 Validation Accuracy: 0.795800 Epoch 12, CIFAR-10 Batch 4: Loss: 0.2080 Validation Accuracy: 0.814000 Epoch 12, CIFAR-10 Batch 5: Loss: 0.0999 Validation Accuracy: 0.814400 Epoch 13, CIFAR-10 Batch 1: Loss: 0.1273 Validation Accuracy: 0.770000 Epoch 13, CIFAR-10 Batch 2: Loss: 0.1604 Validation Accuracy: 0.711200 Epoch 13, CIFAR-10 Batch 3: Loss: 0.1385 Validation Accuracy: 0.837200 Epoch 13, CIFAR-10 Batch 4: Loss: 0.1862 Validation Accuracy: 0.817800 Epoch 13, CIFAR-10 Batch 5: Loss: 0.1030 Validation Accuracy: 0.842200 Epoch 14, CIFAR-10 Batch 1: Loss: 0.1308 Validation Accuracy: 0.786000 Epoch 14, CIFAR-10 Batch 2: Loss: 0.1503 Validation Accuracy: 0.719000 Epoch 14, CIFAR-10 Batch 3: Loss: 0.1404 Validation Accuracy: 0.831000 Epoch 14, CIFAR-10 Batch 4: Loss: 0.1906 Validation Accuracy: 0.832000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.0842 Validation Accuracy: 0.799800 Epoch 15, CIFAR-10 Batch 1: Loss: 0.0990 Validation Accuracy: 0.775400 Epoch 15, CIFAR-10 Batch 2: Loss: 0.1165 Validation Accuracy: 0.802600 Epoch 15, CIFAR-10 Batch 3: Loss: 0.1291 Validation Accuracy: 0.819000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.1524 Validation Accuracy: 0.804400 Epoch 15, CIFAR-10 Batch 5: Loss: 0.0845 Validation Accuracy: 0.797400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.1065 Validation Accuracy: 0.819600 Epoch 16, CIFAR-10 Batch 2: Loss: 0.1240 Validation Accuracy: 0.783200 Epoch 16, CIFAR-10 Batch 3: Loss: 0.1001 Validation Accuracy: 0.853200 Epoch 16, CIFAR-10 Batch 4: Loss: 0.1464 Validation Accuracy: 0.822000 Epoch 16, CIFAR-10 Batch 5: Loss: 0.0845 Validation Accuracy: 0.818400 Epoch 17, CIFAR-10 Batch 1: Loss: 0.0994 Validation Accuracy: 0.811200 Epoch 17, CIFAR-10 Batch 2: Loss: 0.1121 Validation Accuracy: 0.752000 Epoch 17, CIFAR-10 Batch 3: Loss: 0.0966 Validation Accuracy: 0.827600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.1290 Validation Accuracy: 0.827200 Epoch 17, CIFAR-10 Batch 5: Loss: 0.0808 Validation Accuracy: 0.857800 Epoch 18, CIFAR-10 Batch 1: Loss: 0.0959 Validation Accuracy: 0.789400 Epoch 18, CIFAR-10 Batch 2: Loss: 0.1097 Validation Accuracy: 0.831200 Epoch 18, CIFAR-10 Batch 3: Loss: 0.0866 Validation Accuracy: 0.810200 Epoch 18, CIFAR-10 Batch 4: Loss: 0.1034 Validation Accuracy: 0.771200 Epoch 18, CIFAR-10 Batch 5: Loss: 0.0879 Validation Accuracy: 0.854400 Epoch 19, CIFAR-10 Batch 1: Loss: 0.0920 Validation Accuracy: 0.825800 Epoch 19, CIFAR-10 Batch 2: Loss: 0.0963 Validation Accuracy: 0.780000 Epoch 19, CIFAR-10 Batch 3: Loss: 0.0982 Validation Accuracy: 0.805200 Epoch 19, CIFAR-10 Batch 4: Loss: 0.0948 Validation Accuracy: 0.823800 Epoch 19, CIFAR-10 Batch 5: Loss: 0.0821 Validation Accuracy: 0.852000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.0907 Validation Accuracy: 0.799600 Epoch 20, CIFAR-10 Batch 2: Loss: 0.1015 Validation Accuracy: 0.821200 Epoch 20, CIFAR-10 Batch 3: Loss: 0.0860 Validation Accuracy: 0.824200 Epoch 20, CIFAR-10 Batch 4: Loss: 0.0977 Validation Accuracy: 0.816200 Epoch 20, CIFAR-10 Batch 5: Loss: 0.0831 Validation Accuracy: 0.809800 Epoch 21, CIFAR-10 Batch 1: Loss: 0.0949 Validation Accuracy: 0.786200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.0943 Validation Accuracy: 0.837200 Epoch 21, CIFAR-10 Batch 3: Loss: 0.0865 Validation Accuracy: 0.796600 Epoch 21, CIFAR-10 Batch 4: Loss: 0.1036 Validation Accuracy: 0.855800 Epoch 21, CIFAR-10 Batch 5: Loss: 0.0771 Validation Accuracy: 0.839400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.0853 Validation Accuracy: 0.825200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.0971 Validation Accuracy: 0.827000 Epoch 22, CIFAR-10 Batch 3: Loss: 0.0820 Validation Accuracy: 0.845400 Epoch 22, CIFAR-10 Batch 4: Loss: 0.0920 Validation Accuracy: 0.838000 Epoch 22, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.850400 Epoch 23, CIFAR-10 Batch 1: Loss: 0.0795 Validation Accuracy: 0.813000 Epoch 23, CIFAR-10 Batch 2: Loss: 0.0868 Validation Accuracy: 0.822200 Epoch 23, CIFAR-10 Batch 3: Loss: 0.0803 Validation Accuracy: 0.818400 Epoch 23, CIFAR-10 Batch 4: Loss: 0.0853 Validation Accuracy: 0.834600 Epoch 23, CIFAR-10 Batch 5: Loss: 0.0872 Validation Accuracy: 0.812400 Epoch 24, CIFAR-10 Batch 1: Loss: 0.0766 Validation Accuracy: 0.744600 Epoch 24, CIFAR-10 Batch 2: Loss: 0.0806 Validation Accuracy: 0.829200 Epoch 24, CIFAR-10 Batch 3: Loss: 0.0835 Validation Accuracy: 0.831600 Epoch 24, CIFAR-10 Batch 4: Loss: 0.0903 Validation Accuracy: 0.827400 Epoch 24, CIFAR-10 Batch 5: Loss: 0.0763 Validation Accuracy: 0.847600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.0801 Validation Accuracy: 0.817200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.0845 Validation Accuracy: 0.835400 Epoch 25, CIFAR-10 Batch 3: Loss: 0.0814 Validation Accuracy: 0.841400 Epoch 25, CIFAR-10 Batch 4: Loss: 0.0924 Validation Accuracy: 0.834800 Epoch 25, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.819800 Epoch 26, CIFAR-10 Batch 1: Loss: 0.0821 Validation Accuracy: 0.847000 Epoch 26, CIFAR-10 Batch 2: Loss: 0.0867 Validation Accuracy: 0.859600 Epoch 26, CIFAR-10 Batch 3: Loss: 0.0762 Validation Accuracy: 0.851800 Epoch 26, CIFAR-10 Batch 4: Loss: 0.0818 Validation Accuracy: 0.831600 Epoch 26, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.820400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.0782 Validation Accuracy: 0.816600 Epoch 27, CIFAR-10 Batch 2: Loss: 0.0810 Validation Accuracy: 0.855000 Epoch 27, CIFAR-10 Batch 3: Loss: 0.0781 Validation Accuracy: 0.851400 Epoch 27, CIFAR-10 Batch 4: Loss: 0.0899 Validation Accuracy: 0.852400 Epoch 27, CIFAR-10 Batch 5: Loss: 0.0764 Validation Accuracy: 0.795200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.0741 Validation Accuracy: 0.861000 Epoch 28, CIFAR-10 Batch 2: Loss: 0.0793 Validation Accuracy: 0.854000 Epoch 28, CIFAR-10 Batch 3: Loss: 0.0773 Validation Accuracy: 0.840800 Epoch 28, CIFAR-10 Batch 4: Loss: 0.0831 Validation Accuracy: 0.844200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.0729 Validation Accuracy: 0.827400 Epoch 29, CIFAR-10 Batch 1: Loss: 0.0745 Validation Accuracy: 0.814600 Epoch 29, CIFAR-10 Batch 2: Loss: 0.0803 Validation Accuracy: 0.859000 Epoch 29, CIFAR-10 Batch 3: Loss: 0.0773 Validation Accuracy: 0.832000 Epoch 29, CIFAR-10 Batch 4: Loss: 0.0794 Validation Accuracy: 0.833000 Epoch 29, CIFAR-10 Batch 5: Loss: 0.0746 Validation Accuracy: 0.841400 Epoch 30, CIFAR-10 Batch 1: Loss: 0.0800 Validation Accuracy: 0.844400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.0790 Validation Accuracy: 0.853400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.0781 Validation Accuracy: 0.842800 Epoch 30, CIFAR-10 Batch 4: Loss: 0.0817 Validation Accuracy: 0.803800 Epoch 30, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.799800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.0750 Validation Accuracy: 0.810800 Epoch 31, CIFAR-10 Batch 2: Loss: 0.0812 Validation Accuracy: 0.849000 Epoch 31, CIFAR-10 Batch 3: Loss: 0.0790 Validation Accuracy: 0.853000 Epoch 31, CIFAR-10 Batch 4: Loss: 0.0837 Validation Accuracy: 0.819600 Epoch 31, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.841600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.0756 Validation Accuracy: 0.822000 Epoch 32, CIFAR-10 Batch 2: Loss: 0.0830 Validation Accuracy: 0.817200 Epoch 32, CIFAR-10 Batch 3: Loss: 0.0765 Validation Accuracy: 0.830600 Epoch 32, CIFAR-10 Batch 4: Loss: 0.0797 Validation Accuracy: 0.840400 Epoch 32, CIFAR-10 Batch 5: Loss: 0.0749 Validation Accuracy: 0.845800 Epoch 33, CIFAR-10 Batch 1: Loss: 0.0752 Validation Accuracy: 0.816000 Epoch 33, CIFAR-10 Batch 2: Loss: 0.0780 Validation Accuracy: 0.869400 Epoch 33, CIFAR-10 Batch 3: Loss: 0.0755 Validation Accuracy: 0.864800 Epoch 33, CIFAR-10 Batch 4: Loss: 0.0803 Validation Accuracy: 0.867600 Epoch 33, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.857000 Epoch 34, CIFAR-10 Batch 1: Loss: 0.0764 Validation Accuracy: 0.865000 Epoch 34, CIFAR-10 Batch 2: Loss: 0.0785 Validation Accuracy: 0.867400 Epoch 34, CIFAR-10 Batch 3: Loss: 0.0795 Validation Accuracy: 0.859200 Epoch 34, CIFAR-10 Batch 4: Loss: 0.0821 Validation Accuracy: 0.847200 Epoch 34, CIFAR-10 Batch 5: Loss: 0.0787 Validation Accuracy: 0.859200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.0775 Validation Accuracy: 0.848200 Epoch 35, CIFAR-10 Batch 2: Loss: 0.0777 Validation Accuracy: 0.871600 Epoch 35, CIFAR-10 Batch 3: Loss: 0.0781 Validation Accuracy: 0.859400 Epoch 35, CIFAR-10 Batch 4: Loss: 0.0785 Validation Accuracy: 0.851800 Epoch 35, CIFAR-10 Batch 5: Loss: 0.0772 Validation Accuracy: 0.829600 Epoch 36, CIFAR-10 Batch 1: Loss: 0.0753 Validation Accuracy: 0.865200 Epoch 36, CIFAR-10 Batch 2: Loss: 0.0860 Validation Accuracy: 0.849400 Epoch 36, CIFAR-10 Batch 3: Loss: 0.0785 Validation Accuracy: 0.852600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.0814 Validation Accuracy: 0.848400 Epoch 36, CIFAR-10 Batch 5: Loss: 0.0786 Validation Accuracy: 0.846600 Epoch 37, CIFAR-10 Batch 1: Loss: 0.0769 Validation Accuracy: 0.826000 Epoch 37, CIFAR-10 Batch 2: Loss: 0.0811 Validation Accuracy: 0.859600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.0781 Validation Accuracy: 0.843800 Epoch 37, CIFAR-10 Batch 4: Loss: 0.0801 Validation Accuracy: 0.838600 Epoch 37, CIFAR-10 Batch 5: Loss: 0.0766 Validation Accuracy: 0.823000 Epoch 38, CIFAR-10 Batch 1: Loss: 0.0805 Validation Accuracy: 0.848800 Epoch 38, CIFAR-10 Batch 2: Loss: 0.0782 Validation Accuracy: 0.868400 Epoch 38, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.838600 Epoch 38, CIFAR-10 Batch 4: Loss: 0.0824 Validation Accuracy: 0.845600 Epoch 38, CIFAR-10 Batch 5: Loss: 0.0801 Validation Accuracy: 0.866400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.0771 Validation Accuracy: 0.847200 Epoch 39, CIFAR-10 Batch 2: Loss: 0.0816 Validation Accuracy: 0.834400 Epoch 39, CIFAR-10 Batch 3: Loss: 0.0796 Validation Accuracy: 0.850800 Epoch 39, CIFAR-10 Batch 4: Loss: 0.0789 Validation Accuracy: 0.853800 Epoch 39, CIFAR-10 Batch 5: Loss: 0.0788 Validation Accuracy: 0.876000 Epoch 40, CIFAR-10 Batch 1: Loss: 0.0763 Validation Accuracy: 0.859000 Epoch 40, CIFAR-10 Batch 2: Loss: 0.0767 Validation Accuracy: 0.831800 Epoch 40, CIFAR-10 Batch 3: Loss: 0.0772 Validation Accuracy: 0.858200 Epoch 40, CIFAR-10 Batch 4: Loss: 0.0778 Validation Accuracy: 0.849000 Epoch 40, CIFAR-10 Batch 5: Loss: 0.0793 Validation Accuracy: 0.851800 Epoch 41, CIFAR-10 Batch 1: Loss: 0.0792 Validation Accuracy: 0.834200 Epoch 41, CIFAR-10 Batch 2: Loss: 0.0792 Validation Accuracy: 0.848200 Epoch 41, CIFAR-10 Batch 3: Loss: 0.0787 Validation Accuracy: 0.870000 Epoch 41, CIFAR-10 Batch 4: Loss: 0.0786 Validation Accuracy: 0.847600 Epoch 41, CIFAR-10 Batch 5: Loss: 0.0770 Validation Accuracy: 0.839000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.0798 Validation Accuracy: 0.826200 Epoch 42, CIFAR-10 Batch 2: Loss: 0.0784 Validation Accuracy: 0.836200 Epoch 42, CIFAR-10 Batch 3: Loss: 0.0795 Validation Accuracy: 0.849600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.0771 Validation Accuracy: 0.815000 Epoch 42, CIFAR-10 Batch 5: Loss: 0.0771 Validation Accuracy: 0.864200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.0767 Validation Accuracy: 0.855200 Epoch 43, CIFAR-10 Batch 2: Loss: 0.0823 Validation Accuracy: 0.859200 Epoch 43, CIFAR-10 Batch 3: Loss: 0.0780 Validation Accuracy: 0.834000 Epoch 43, CIFAR-10 Batch 4: Loss: 0.0808 Validation Accuracy: 0.856600 Epoch 43, CIFAR-10 Batch 5: Loss: 0.0766 Validation Accuracy: 0.876600 Epoch 44, CIFAR-10 Batch 1: Loss: 0.0784 Validation Accuracy: 0.837800 Epoch 44, CIFAR-10 Batch 2: Loss: 0.0805 Validation Accuracy: 0.875800 Epoch 44, CIFAR-10 Batch 3: Loss: 0.0773 Validation Accuracy: 0.860800 Epoch 44, CIFAR-10 Batch 4: Loss: 0.0775 Validation Accuracy: 0.840200 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0776 Validation Accuracy: 0.864400 Epoch 45, CIFAR-10 Batch 1: Loss: 0.0783 Validation Accuracy: 0.857800 Epoch 45, CIFAR-10 Batch 2: Loss: 0.0783 Validation Accuracy: 0.882000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.0772 Validation Accuracy: 0.857400 Epoch 45, CIFAR-10 Batch 4: Loss: 0.0779 Validation Accuracy: 0.848400 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.857400 Epoch 46, CIFAR-10 Batch 1: Loss: 0.0785 Validation Accuracy: 0.863600 Epoch 46, CIFAR-10 Batch 2: Loss: 0.0786 Validation Accuracy: 0.867800 Epoch 46, CIFAR-10 Batch 3: Loss: 0.0767 Validation Accuracy: 0.871200 Epoch 46, CIFAR-10 Batch 4: Loss: 0.0783 Validation Accuracy: 0.851400 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.858000 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0763 Validation Accuracy: 0.814600 Epoch 47, CIFAR-10 Batch 2: Loss: 0.0784 Validation Accuracy: 0.869400 Epoch 47, CIFAR-10 Batch 3: Loss: 0.0800 Validation Accuracy: 0.844400 Epoch 47, CIFAR-10 Batch 4: Loss: 0.0791 Validation Accuracy: 0.820800 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.850400 Epoch 48, CIFAR-10 Batch 1: Loss: 0.0767 Validation Accuracy: 0.855200 Epoch 48, CIFAR-10 Batch 2: Loss: 0.0789 Validation Accuracy: 0.840800 Epoch 48, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.854800 Epoch 48, CIFAR-10 Batch 4: Loss: 0.0789 Validation Accuracy: 0.843200 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0769 Validation Accuracy: 0.852200 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.843600 Epoch 49, CIFAR-10 Batch 2: Loss: 0.0802 Validation Accuracy: 0.859200 Epoch 49, CIFAR-10 Batch 3: Loss: 0.0773 Validation Accuracy: 0.863200 Epoch 49, CIFAR-10 Batch 4: Loss: 0.0811 Validation Accuracy: 0.841400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0767 Validation Accuracy: 0.849200 Epoch 50, CIFAR-10 Batch 1: Loss: 0.0774 Validation Accuracy: 0.862400 Epoch 50, CIFAR-10 Batch 2: Loss: 0.0815 Validation Accuracy: 0.856200 Epoch 50, CIFAR-10 Batch 3: Loss: 0.0784 Validation Accuracy: 0.870000 Epoch 50, CIFAR-10 Batch 4: Loss: 0.0788 Validation Accuracy: 0.860200 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0778 Validation Accuracy: 0.865600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.856000 Epoch 51, CIFAR-10 Batch 2: Loss: 0.0770 Validation Accuracy: 0.866800 Epoch 51, CIFAR-10 Batch 3: Loss: 0.0770 Validation Accuracy: 0.864400 Epoch 51, CIFAR-10 Batch 4: Loss: 0.0793 Validation Accuracy: 0.871600 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0760 Validation Accuracy: 0.859400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0760 Validation Accuracy: 0.862400 Epoch 52, CIFAR-10 Batch 2: Loss: 0.0790 Validation Accuracy: 0.865800 Epoch 52, CIFAR-10 Batch 3: Loss: 0.0782 Validation Accuracy: 0.874600 Epoch 52, CIFAR-10 Batch 4: Loss: 0.0826 Validation Accuracy: 0.865400 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0778 Validation Accuracy: 0.841600 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0786 Validation Accuracy: 0.845200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.0769 Validation Accuracy: 0.855400 Epoch 53, CIFAR-10 Batch 3: Loss: 0.0780 Validation Accuracy: 0.873800 Epoch 53, CIFAR-10 Batch 4: Loss: 0.0790 Validation Accuracy: 0.860000 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0764 Validation Accuracy: 0.868000 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0769 Validation Accuracy: 0.836000 Epoch 54, CIFAR-10 Batch 2: Loss: 0.0780 Validation Accuracy: 0.871400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.0778 Validation Accuracy: 0.863000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.0784 Validation Accuracy: 0.863200 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.864800 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0758 Validation Accuracy: 0.872600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.0771 Validation Accuracy: 0.856200 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0781 Validation Accuracy: 0.870400 Epoch 55, CIFAR-10 Batch 4: Loss: 0.0785 Validation Accuracy: 0.838800 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0761 Validation Accuracy: 0.845400 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0768 Validation Accuracy: 0.824600 Epoch 56, CIFAR-10 Batch 2: Loss: 0.0782 Validation Accuracy: 0.849400 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0770 Validation Accuracy: 0.869400 Epoch 56, CIFAR-10 Batch 4: Loss: 0.0777 Validation Accuracy: 0.849200 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0770 Validation Accuracy: 0.849400 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0766 Validation Accuracy: 0.850400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.0767 Validation Accuracy: 0.863400 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0771 Validation Accuracy: 0.870400 Epoch 57, CIFAR-10 Batch 4: Loss: 0.0808 Validation Accuracy: 0.845600 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0764 Validation Accuracy: 0.870600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0776 Validation Accuracy: 0.861800 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0791 Validation Accuracy: 0.856800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0776 Validation Accuracy: 0.876600 Epoch 58, CIFAR-10 Batch 4: Loss: 0.0816 Validation Accuracy: 0.857200 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0778 Validation Accuracy: 0.842600 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0769 Validation Accuracy: 0.846800 Epoch 59, CIFAR-10 Batch 2: Loss: 0.0771 Validation Accuracy: 0.878400 Epoch 59, CIFAR-10 Batch 3: Loss: 0.0785 Validation Accuracy: 0.865400 Epoch 59, CIFAR-10 Batch 4: Loss: 0.0787 Validation Accuracy: 0.855600 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0761 Validation Accuracy: 0.874400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0766 Validation Accuracy: 0.871400 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0776 Validation Accuracy: 0.871000 Epoch 60, CIFAR-10 Batch 3: Loss: 0.0779 Validation Accuracy: 0.863400 Epoch 60, CIFAR-10 Batch 4: Loss: 0.0777 Validation Accuracy: 0.872200 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0762 Validation Accuracy: 0.864000 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0782 Validation Accuracy: 0.862200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.0790 Validation Accuracy: 0.863400 Epoch 61, CIFAR-10 Batch 3: Loss: 0.0766 Validation Accuracy: 0.865600 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0774 Validation Accuracy: 0.870200 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0758 Validation Accuracy: 0.854200 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0763 Validation Accuracy: 0.838800 Epoch 62, CIFAR-10 Batch 2: Loss: 0.0793 Validation Accuracy: 0.863600 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0769 Validation Accuracy: 0.853800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0790 Validation Accuracy: 0.868600 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0765 Validation Accuracy: 0.854000 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0759 Validation Accuracy: 0.875200 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0766 Validation Accuracy: 0.874800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0764 Validation Accuracy: 0.853400 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0777 Validation Accuracy: 0.865800 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.853800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0774 Validation Accuracy: 0.844200 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0769 Validation Accuracy: 0.868200 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0774 Validation Accuracy: 0.852000 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0780 Validation Accuracy: 0.862400 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.840800 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0755 Validation Accuracy: 0.865400 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0763 Validation Accuracy: 0.868600 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0761 Validation Accuracy: 0.861400 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.849200 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.875600 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0757 Validation Accuracy: 0.869800 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0758 Validation Accuracy: 0.879000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0784 Validation Accuracy: 0.867000 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0772 Validation Accuracy: 0.827600 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.842000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0764 Validation Accuracy: 0.875600 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0763 Validation Accuracy: 0.862200 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0764 Validation Accuracy: 0.878400 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0767 Validation Accuracy: 0.874000 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.873200 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0762 Validation Accuracy: 0.868800 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0769 Validation Accuracy: 0.885400 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0762 Validation Accuracy: 0.883200 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0763 Validation Accuracy: 0.860200 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0757 Validation Accuracy: 0.859600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0757 Validation Accuracy: 0.835600 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0773 Validation Accuracy: 0.849600 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0761 Validation Accuracy: 0.870600 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0760 Validation Accuracy: 0.875800 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0756 Validation Accuracy: 0.852400 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0775 Validation Accuracy: 0.843200 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0766 Validation Accuracy: 0.862000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0755 Validation Accuracy: 0.864000 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0761 Validation Accuracy: 0.843400 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0753 Validation Accuracy: 0.869200 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0758 Validation Accuracy: 0.862400 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0767 Validation Accuracy: 0.872000 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0756 Validation Accuracy: 0.849600 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0794 Validation Accuracy: 0.852400 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0755 Validation Accuracy: 0.860800 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0761 Validation Accuracy: 0.867400 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0763 Validation Accuracy: 0.875200 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0753 Validation Accuracy: 0.870000 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0757 Validation Accuracy: 0.860800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0751 Validation Accuracy: 0.858600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0755 Validation Accuracy: 0.852200 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0755 Validation Accuracy: 0.878400 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0752 Validation Accuracy: 0.872200 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0765 Validation Accuracy: 0.855800 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0752 Validation Accuracy: 0.863400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0756 Validation Accuracy: 0.859400 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0761 Validation Accuracy: 0.876200 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0767 Validation Accuracy: 0.865400 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0763 Validation Accuracy: 0.858800 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0754 Validation Accuracy: 0.874800 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0753 Validation Accuracy: 0.878800 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0775 Validation Accuracy: 0.873200 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0757 Validation Accuracy: 0.879200 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0756 Validation Accuracy: 0.847600 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0750 Validation Accuracy: 0.865000 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0746 Validation Accuracy: 0.873400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0760 Validation Accuracy: 0.856200 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0753 Validation Accuracy: 0.860400 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0754 Validation Accuracy: 0.848400 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.860000 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0749 Validation Accuracy: 0.877000 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0754 Validation Accuracy: 0.873000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0760 Validation Accuracy: 0.863600 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0763 Validation Accuracy: 0.869400 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0752 Validation Accuracy: 0.856000 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0748 Validation Accuracy: 0.851000 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0752 Validation Accuracy: 0.870000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0752 Validation Accuracy: 0.877600 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0752 Validation Accuracy: 0.849000 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0750 Validation Accuracy: 0.852600 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0757 Validation Accuracy: 0.866800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0756 Validation Accuracy: 0.880400 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0747 Validation Accuracy: 0.881600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0751 Validation Accuracy: 0.861600 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.877800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0748 Validation Accuracy: 0.872400 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0748 Validation Accuracy: 0.862600 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0748 Validation Accuracy: 0.870800 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0749 Validation Accuracy: 0.855800 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0747 Validation Accuracy: 0.859200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0751 Validation Accuracy: 0.843400 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0750 Validation Accuracy: 0.874600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0750 Validation Accuracy: 0.844200 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0753 Validation Accuracy: 0.837200 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0749 Validation Accuracy: 0.875600 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0748 Validation Accuracy: 0.888600 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0747 Validation Accuracy: 0.894200 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0746 Validation Accuracy: 0.897000 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0742 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0739 Validation Accuracy: 0.895600 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0740 Validation Accuracy: 0.897400 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898000 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0741 Validation Accuracy: 0.898000 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.900000 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898600 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898600 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.898800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899600 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898600 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899800 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898600 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899000 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899800 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899000 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.898800 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898600 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899400 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899600 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899000 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898400 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899800 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899400 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.899200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0739 Validation Accuracy: 0.899600 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0740 Validation Accuracy: 0.899200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0740 Validation Accuracy: 0.898600 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0739 Validation Accuracy: 0.899400 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0738 Validation Accuracy: 0.898800 Training for learning_rate=0.00010, batch_size=128 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.9567 Validation Accuracy: 0.098200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.9430 Validation Accuracy: 0.134400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.8059 Validation Accuracy: 0.178400 Epoch 1, CIFAR-10 Batch 4: Loss: 1.7347 Validation Accuracy: 0.213000 Epoch 1, CIFAR-10 Batch 5: Loss: 1.7234 Validation Accuracy: 0.320400 Epoch 2, CIFAR-10 Batch 1: Loss: 1.4987 Validation Accuracy: 0.389000 Epoch 2, CIFAR-10 Batch 2: Loss: 1.7145 Validation Accuracy: 0.426000 Epoch 2, CIFAR-10 Batch 3: Loss: 1.5770 Validation Accuracy: 0.464400 Epoch 2, CIFAR-10 Batch 4: Loss: 1.5246 Validation Accuracy: 0.453600 Epoch 2, CIFAR-10 Batch 5: Loss: 1.5184 Validation Accuracy: 0.485000 Epoch 3, CIFAR-10 Batch 1: Loss: 1.3402 Validation Accuracy: 0.479800 Epoch 3, CIFAR-10 Batch 2: Loss: 1.6223 Validation Accuracy: 0.461200 Epoch 3, CIFAR-10 Batch 3: Loss: 1.3189 Validation Accuracy: 0.546800 Epoch 3, CIFAR-10 Batch 4: Loss: 1.3671 Validation Accuracy: 0.523000 Epoch 3, CIFAR-10 Batch 5: Loss: 1.3712 Validation Accuracy: 0.523000 Epoch 4, CIFAR-10 Batch 1: Loss: 1.2354 Validation Accuracy: 0.504200 Epoch 4, CIFAR-10 Batch 2: Loss: 1.5227 Validation Accuracy: 0.505400 Epoch 4, CIFAR-10 Batch 3: Loss: 1.1777 Validation Accuracy: 0.592800 Epoch 4, CIFAR-10 Batch 4: Loss: 1.2629 Validation Accuracy: 0.559400 Epoch 4, CIFAR-10 Batch 5: Loss: 1.2613 Validation Accuracy: 0.511400 Epoch 5, CIFAR-10 Batch 1: Loss: 1.1525 Validation Accuracy: 0.514600 Epoch 5, CIFAR-10 Batch 2: Loss: 1.4701 Validation Accuracy: 0.521200 Epoch 5, CIFAR-10 Batch 3: Loss: 1.0650 Validation Accuracy: 0.631600 Epoch 5, CIFAR-10 Batch 4: Loss: 1.1822 Validation Accuracy: 0.582200 Epoch 5, CIFAR-10 Batch 5: Loss: 1.1709 Validation Accuracy: 0.551400 Epoch 6, CIFAR-10 Batch 1: Loss: 1.1097 Validation Accuracy: 0.555200 Epoch 6, CIFAR-10 Batch 2: Loss: 1.3674 Validation Accuracy: 0.587000 Epoch 6, CIFAR-10 Batch 3: Loss: 0.9748 Validation Accuracy: 0.655000 Epoch 6, CIFAR-10 Batch 4: Loss: 1.1192 Validation Accuracy: 0.610800 Epoch 6, CIFAR-10 Batch 5: Loss: 1.0906 Validation Accuracy: 0.598600 Epoch 7, CIFAR-10 Batch 1: Loss: 1.0258 Validation Accuracy: 0.561800 Epoch 7, CIFAR-10 Batch 2: Loss: 1.2936 Validation Accuracy: 0.582800 Epoch 7, CIFAR-10 Batch 3: Loss: 0.8753 Validation Accuracy: 0.643600 Epoch 7, CIFAR-10 Batch 4: Loss: 1.0594 Validation Accuracy: 0.642800 Epoch 7, CIFAR-10 Batch 5: Loss: 1.0145 Validation Accuracy: 0.624000 Epoch 8, CIFAR-10 Batch 1: Loss: 0.9837 Validation Accuracy: 0.596600 Epoch 8, CIFAR-10 Batch 2: Loss: 1.2106 Validation Accuracy: 0.626400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.8129 Validation Accuracy: 0.647000 Epoch 8, CIFAR-10 Batch 4: Loss: 1.0158 Validation Accuracy: 0.655000 Epoch 8, CIFAR-10 Batch 5: Loss: 0.9747 Validation Accuracy: 0.619000 Epoch 9, CIFAR-10 Batch 1: Loss: 0.9214 Validation Accuracy: 0.631000 Epoch 9, CIFAR-10 Batch 2: Loss: 1.1626 Validation Accuracy: 0.612200 Epoch 9, CIFAR-10 Batch 3: Loss: 0.7873 Validation Accuracy: 0.683600 Epoch 9, CIFAR-10 Batch 4: Loss: 0.9517 Validation Accuracy: 0.666800 Epoch 9, CIFAR-10 Batch 5: Loss: 0.9123 Validation Accuracy: 0.621000 Epoch 10, CIFAR-10 Batch 1: Loss: 0.8610 Validation Accuracy: 0.630400 Epoch 10, CIFAR-10 Batch 2: Loss: 1.0826 Validation Accuracy: 0.631200 Epoch 10, CIFAR-10 Batch 3: Loss: 0.7306 Validation Accuracy: 0.681200 Epoch 10, CIFAR-10 Batch 4: Loss: 0.8980 Validation Accuracy: 0.672800 Epoch 10, CIFAR-10 Batch 5: Loss: 0.8561 Validation Accuracy: 0.637800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.8257 Validation Accuracy: 0.660800 Epoch 11, CIFAR-10 Batch 2: Loss: 1.0339 Validation Accuracy: 0.668600 Epoch 11, CIFAR-10 Batch 3: Loss: 0.6754 Validation Accuracy: 0.704200 Epoch 11, CIFAR-10 Batch 4: Loss: 0.8317 Validation Accuracy: 0.657600 Epoch 11, CIFAR-10 Batch 5: Loss: 0.7906 Validation Accuracy: 0.649000 Epoch 12, CIFAR-10 Batch 1: Loss: 0.7527 Validation Accuracy: 0.685800 Epoch 12, CIFAR-10 Batch 2: Loss: 0.9741 Validation Accuracy: 0.645400 Epoch 12, CIFAR-10 Batch 3: Loss: 0.6507 Validation Accuracy: 0.706400 Epoch 12, CIFAR-10 Batch 4: Loss: 0.7942 Validation Accuracy: 0.703800 Epoch 12, CIFAR-10 Batch 5: Loss: 0.7409 Validation Accuracy: 0.654800 Epoch 13, CIFAR-10 Batch 1: Loss: 0.7168 Validation Accuracy: 0.678000 Epoch 13, CIFAR-10 Batch 2: Loss: 0.9411 Validation Accuracy: 0.685200 Epoch 13, CIFAR-10 Batch 3: Loss: 0.6315 Validation Accuracy: 0.698400 Epoch 13, CIFAR-10 Batch 4: Loss: 0.7438 Validation Accuracy: 0.703000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.7260 Validation Accuracy: 0.660600 Epoch 14, CIFAR-10 Batch 1: Loss: 0.6632 Validation Accuracy: 0.707800 Epoch 14, CIFAR-10 Batch 2: Loss: 0.8828 Validation Accuracy: 0.670600 Epoch 14, CIFAR-10 Batch 3: Loss: 0.6050 Validation Accuracy: 0.707600 Epoch 14, CIFAR-10 Batch 4: Loss: 0.7006 Validation Accuracy: 0.701600 Epoch 14, CIFAR-10 Batch 5: Loss: 0.6565 Validation Accuracy: 0.680200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.6514 Validation Accuracy: 0.697800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.8440 Validation Accuracy: 0.668800 Epoch 15, CIFAR-10 Batch 3: Loss: 0.5846 Validation Accuracy: 0.723000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.6610 Validation Accuracy: 0.739400 Epoch 15, CIFAR-10 Batch 5: Loss: 0.6408 Validation Accuracy: 0.680400 Epoch 16, CIFAR-10 Batch 1: Loss: 0.5923 Validation Accuracy: 0.682200 Epoch 16, CIFAR-10 Batch 2: Loss: 0.7777 Validation Accuracy: 0.699000 Epoch 16, CIFAR-10 Batch 3: Loss: 0.5669 Validation Accuracy: 0.731600 Epoch 16, CIFAR-10 Batch 4: Loss: 0.6353 Validation Accuracy: 0.719000 Epoch 16, CIFAR-10 Batch 5: Loss: 0.5710 Validation Accuracy: 0.714000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.5801 Validation Accuracy: 0.723600 Epoch 17, CIFAR-10 Batch 2: Loss: 0.7433 Validation Accuracy: 0.702600 Epoch 17, CIFAR-10 Batch 3: Loss: 0.5237 Validation Accuracy: 0.728400 Epoch 17, CIFAR-10 Batch 4: Loss: 0.6056 Validation Accuracy: 0.686200 Epoch 17, CIFAR-10 Batch 5: Loss: 0.5595 Validation Accuracy: 0.690800 Epoch 18, CIFAR-10 Batch 1: Loss: 0.5560 Validation Accuracy: 0.728800 Epoch 18, CIFAR-10 Batch 2: Loss: 0.7091 Validation Accuracy: 0.694800 Epoch 18, CIFAR-10 Batch 3: Loss: 0.5177 Validation Accuracy: 0.723600 Epoch 18, CIFAR-10 Batch 4: Loss: 0.5802 Validation Accuracy: 0.718200 Epoch 18, CIFAR-10 Batch 5: Loss: 0.5144 Validation Accuracy: 0.715600 Epoch 19, CIFAR-10 Batch 1: Loss: 0.5213 Validation Accuracy: 0.756000 Epoch 19, CIFAR-10 Batch 2: Loss: 0.6630 Validation Accuracy: 0.711600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.4968 Validation Accuracy: 0.715800 Epoch 19, CIFAR-10 Batch 4: Loss: 0.5724 Validation Accuracy: 0.729000 Epoch 19, CIFAR-10 Batch 5: Loss: 0.4862 Validation Accuracy: 0.722000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.4917 Validation Accuracy: 0.738800 Epoch 20, CIFAR-10 Batch 2: Loss: 0.6457 Validation Accuracy: 0.703600 Epoch 20, CIFAR-10 Batch 3: Loss: 0.4844 Validation Accuracy: 0.727800 Epoch 20, CIFAR-10 Batch 4: Loss: 0.5404 Validation Accuracy: 0.720800 Epoch 20, CIFAR-10 Batch 5: Loss: 0.4559 Validation Accuracy: 0.702800 Epoch 21, CIFAR-10 Batch 1: Loss: 0.4776 Validation Accuracy: 0.745600 Epoch 21, CIFAR-10 Batch 2: Loss: 0.6027 Validation Accuracy: 0.710200 Epoch 21, CIFAR-10 Batch 3: Loss: 0.4528 Validation Accuracy: 0.725000 Epoch 21, CIFAR-10 Batch 4: Loss: 0.5252 Validation Accuracy: 0.753000 Epoch 21, CIFAR-10 Batch 5: Loss: 0.4255 Validation Accuracy: 0.750200 Epoch 22, CIFAR-10 Batch 1: Loss: 0.4613 Validation Accuracy: 0.743200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.5815 Validation Accuracy: 0.722600 Epoch 22, CIFAR-10 Batch 3: Loss: 0.4310 Validation Accuracy: 0.740200 Epoch 22, CIFAR-10 Batch 4: Loss: 0.5054 Validation Accuracy: 0.757400 Epoch 22, CIFAR-10 Batch 5: Loss: 0.3983 Validation Accuracy: 0.732800 Epoch 23, CIFAR-10 Batch 1: Loss: 0.4302 Validation Accuracy: 0.779400 Epoch 23, CIFAR-10 Batch 2: Loss: 0.5495 Validation Accuracy: 0.729400 Epoch 23, CIFAR-10 Batch 3: Loss: 0.4254 Validation Accuracy: 0.738000 Epoch 23, CIFAR-10 Batch 4: Loss: 0.4748 Validation Accuracy: 0.743400 Epoch 23, CIFAR-10 Batch 5: Loss: 0.3683 Validation Accuracy: 0.754800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.4066 Validation Accuracy: 0.756000 Epoch 24, CIFAR-10 Batch 2: Loss: 0.5075 Validation Accuracy: 0.703000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.3991 Validation Accuracy: 0.738200 Epoch 24, CIFAR-10 Batch 4: Loss: 0.4509 Validation Accuracy: 0.752000 Epoch 24, CIFAR-10 Batch 5: Loss: 0.3549 Validation Accuracy: 0.739600 Epoch 25, CIFAR-10 Batch 1: Loss: 0.4039 Validation Accuracy: 0.761200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.5078 Validation Accuracy: 0.732800 Epoch 25, CIFAR-10 Batch 3: Loss: 0.3897 Validation Accuracy: 0.726800 Epoch 25, CIFAR-10 Batch 4: Loss: 0.4355 Validation Accuracy: 0.760600 Epoch 25, CIFAR-10 Batch 5: Loss: 0.3112 Validation Accuracy: 0.748800 Epoch 26, CIFAR-10 Batch 1: Loss: 0.3657 Validation Accuracy: 0.792000 Epoch 26, CIFAR-10 Batch 2: Loss: 0.4884 Validation Accuracy: 0.733800 Epoch 26, CIFAR-10 Batch 3: Loss: 0.3748 Validation Accuracy: 0.730800 Epoch 26, CIFAR-10 Batch 4: Loss: 0.4311 Validation Accuracy: 0.771800 Epoch 26, CIFAR-10 Batch 5: Loss: 0.2929 Validation Accuracy: 0.754000 Epoch 27, CIFAR-10 Batch 1: Loss: 0.3521 Validation Accuracy: 0.775800 Epoch 27, CIFAR-10 Batch 2: Loss: 0.4522 Validation Accuracy: 0.747600 Epoch 27, CIFAR-10 Batch 3: Loss: 0.3567 Validation Accuracy: 0.742200 Epoch 27, CIFAR-10 Batch 4: Loss: 0.4031 Validation Accuracy: 0.773800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.2832 Validation Accuracy: 0.756000 Epoch 28, CIFAR-10 Batch 1: Loss: 0.3219 Validation Accuracy: 0.762800 Epoch 28, CIFAR-10 Batch 2: Loss: 0.4291 Validation Accuracy: 0.729200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.3515 Validation Accuracy: 0.759600 Epoch 28, CIFAR-10 Batch 4: Loss: 0.3987 Validation Accuracy: 0.756200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.2549 Validation Accuracy: 0.781800 Epoch 29, CIFAR-10 Batch 1: Loss: 0.3250 Validation Accuracy: 0.777200 Epoch 29, CIFAR-10 Batch 2: Loss: 0.3950 Validation Accuracy: 0.751200 Epoch 29, CIFAR-10 Batch 3: Loss: 0.3278 Validation Accuracy: 0.768600 Epoch 29, CIFAR-10 Batch 4: Loss: 0.3930 Validation Accuracy: 0.768200 Epoch 29, CIFAR-10 Batch 5: Loss: 0.2503 Validation Accuracy: 0.752200 Epoch 30, CIFAR-10 Batch 1: Loss: 0.2902 Validation Accuracy: 0.793800 Epoch 30, CIFAR-10 Batch 2: Loss: 0.3700 Validation Accuracy: 0.748000 Epoch 30, CIFAR-10 Batch 3: Loss: 0.3260 Validation Accuracy: 0.757200 Epoch 30, CIFAR-10 Batch 4: Loss: 0.3718 Validation Accuracy: 0.777200 Epoch 30, CIFAR-10 Batch 5: Loss: 0.2211 Validation Accuracy: 0.779800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.2622 Validation Accuracy: 0.792000 Epoch 31, CIFAR-10 Batch 2: Loss: 0.3621 Validation Accuracy: 0.773600 Epoch 31, CIFAR-10 Batch 3: Loss: 0.3032 Validation Accuracy: 0.775800 Epoch 31, CIFAR-10 Batch 4: Loss: 0.3539 Validation Accuracy: 0.779600 Epoch 31, CIFAR-10 Batch 5: Loss: 0.2211 Validation Accuracy: 0.760200 Epoch 32, CIFAR-10 Batch 1: Loss: 0.2534 Validation Accuracy: 0.785400 Epoch 32, CIFAR-10 Batch 2: Loss: 0.3303 Validation Accuracy: 0.750400 Epoch 32, CIFAR-10 Batch 3: Loss: 0.2915 Validation Accuracy: 0.781600 Epoch 32, CIFAR-10 Batch 4: Loss: 0.3332 Validation Accuracy: 0.773800 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1966 Validation Accuracy: 0.777000 Epoch 33, CIFAR-10 Batch 1: Loss: 0.2468 Validation Accuracy: 0.783400 Epoch 33, CIFAR-10 Batch 2: Loss: 0.3209 Validation Accuracy: 0.763000 Epoch 33, CIFAR-10 Batch 3: Loss: 0.2760 Validation Accuracy: 0.777800 Epoch 33, CIFAR-10 Batch 4: Loss: 0.3303 Validation Accuracy: 0.763800 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1878 Validation Accuracy: 0.780400 Epoch 34, CIFAR-10 Batch 1: Loss: 0.2340 Validation Accuracy: 0.798400 Epoch 34, CIFAR-10 Batch 2: Loss: 0.3015 Validation Accuracy: 0.767600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.2726 Validation Accuracy: 0.798800 Epoch 34, CIFAR-10 Batch 4: Loss: 0.3096 Validation Accuracy: 0.758800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1805 Validation Accuracy: 0.772000 Epoch 35, CIFAR-10 Batch 1: Loss: 0.2245 Validation Accuracy: 0.798000 Epoch 35, CIFAR-10 Batch 2: Loss: 0.2859 Validation Accuracy: 0.767600 Epoch 35, CIFAR-10 Batch 3: Loss: 0.2360 Validation Accuracy: 0.791000 Epoch 35, CIFAR-10 Batch 4: Loss: 0.2981 Validation Accuracy: 0.793000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1644 Validation Accuracy: 0.763200 Epoch 36, CIFAR-10 Batch 1: Loss: 0.2207 Validation Accuracy: 0.788400 Epoch 36, CIFAR-10 Batch 2: Loss: 0.2693 Validation Accuracy: 0.777200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.2436 Validation Accuracy: 0.795800 Epoch 36, CIFAR-10 Batch 4: Loss: 0.2823 Validation Accuracy: 0.794600 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1544 Validation Accuracy: 0.761000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.2058 Validation Accuracy: 0.806400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.2691 Validation Accuracy: 0.753200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.2339 Validation Accuracy: 0.771800 Epoch 37, CIFAR-10 Batch 4: Loss: 0.2750 Validation Accuracy: 0.790800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1526 Validation Accuracy: 0.789400 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1971 Validation Accuracy: 0.798600 Epoch 38, CIFAR-10 Batch 2: Loss: 0.2519 Validation Accuracy: 0.791600 Epoch 38, CIFAR-10 Batch 3: Loss: 0.2130 Validation Accuracy: 0.776800 Epoch 38, CIFAR-10 Batch 4: Loss: 0.2728 Validation Accuracy: 0.797800 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1373 Validation Accuracy: 0.782400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1800 Validation Accuracy: 0.809000 Epoch 39, CIFAR-10 Batch 2: Loss: 0.2319 Validation Accuracy: 0.774800 Epoch 39, CIFAR-10 Batch 3: Loss: 0.2151 Validation Accuracy: 0.800800 Epoch 39, CIFAR-10 Batch 4: Loss: 0.2592 Validation Accuracy: 0.805000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1375 Validation Accuracy: 0.763000 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1916 Validation Accuracy: 0.799200 Epoch 40, CIFAR-10 Batch 2: Loss: 0.2217 Validation Accuracy: 0.785200 Epoch 40, CIFAR-10 Batch 3: Loss: 0.2045 Validation Accuracy: 0.782800 Epoch 40, CIFAR-10 Batch 4: Loss: 0.2518 Validation Accuracy: 0.805400 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1265 Validation Accuracy: 0.790400 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1585 Validation Accuracy: 0.808200 Epoch 41, CIFAR-10 Batch 2: Loss: 0.2227 Validation Accuracy: 0.785800 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1929 Validation Accuracy: 0.809200 Epoch 41, CIFAR-10 Batch 4: Loss: 0.2255 Validation Accuracy: 0.791000 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1158 Validation Accuracy: 0.785400 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1595 Validation Accuracy: 0.817400 Epoch 42, CIFAR-10 Batch 2: Loss: 0.2247 Validation Accuracy: 0.767000 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1819 Validation Accuracy: 0.796800 Epoch 42, CIFAR-10 Batch 4: Loss: 0.2323 Validation Accuracy: 0.812400 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1129 Validation Accuracy: 0.793800 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1369 Validation Accuracy: 0.807400 Epoch 43, CIFAR-10 Batch 2: Loss: 0.2172 Validation Accuracy: 0.794200 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1796 Validation Accuracy: 0.794600 Epoch 43, CIFAR-10 Batch 4: Loss: 0.2253 Validation Accuracy: 0.792400 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1088 Validation Accuracy: 0.807000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1474 Validation Accuracy: 0.817600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1973 Validation Accuracy: 0.808400 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1769 Validation Accuracy: 0.808400 Epoch 44, CIFAR-10 Batch 4: Loss: 0.2126 Validation Accuracy: 0.807400 Epoch 44, CIFAR-10 Batch 5: Loss: 0.1038 Validation Accuracy: 0.804800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1275 Validation Accuracy: 0.807200 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1917 Validation Accuracy: 0.769800 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1607 Validation Accuracy: 0.788200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.2132 Validation Accuracy: 0.787600 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0974 Validation Accuracy: 0.814600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1291 Validation Accuracy: 0.808000 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1870 Validation Accuracy: 0.789400 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1537 Validation Accuracy: 0.790000 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1943 Validation Accuracy: 0.802000 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0918 Validation Accuracy: 0.798800 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1165 Validation Accuracy: 0.822600 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1673 Validation Accuracy: 0.791000 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1512 Validation Accuracy: 0.809800 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1840 Validation Accuracy: 0.796200 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0990 Validation Accuracy: 0.800000 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1243 Validation Accuracy: 0.811200 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1774 Validation Accuracy: 0.791400 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1363 Validation Accuracy: 0.817400 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1858 Validation Accuracy: 0.802400 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0859 Validation Accuracy: 0.807400 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1052 Validation Accuracy: 0.807200 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1667 Validation Accuracy: 0.790400 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1426 Validation Accuracy: 0.814400 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1679 Validation Accuracy: 0.803400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0887 Validation Accuracy: 0.793200 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1007 Validation Accuracy: 0.831000 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1537 Validation Accuracy: 0.800800 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1270 Validation Accuracy: 0.808600 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1671 Validation Accuracy: 0.797400 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0841 Validation Accuracy: 0.785600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1176 Validation Accuracy: 0.810400 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1617 Validation Accuracy: 0.779400 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1310 Validation Accuracy: 0.821600 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1655 Validation Accuracy: 0.820600 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0817 Validation Accuracy: 0.790000 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0933 Validation Accuracy: 0.818600 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1401 Validation Accuracy: 0.789200 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1275 Validation Accuracy: 0.806200 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1483 Validation Accuracy: 0.800600 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0770 Validation Accuracy: 0.800400 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0936 Validation Accuracy: 0.819200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1392 Validation Accuracy: 0.809000 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1274 Validation Accuracy: 0.803400 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1383 Validation Accuracy: 0.820600 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0788 Validation Accuracy: 0.784400 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0913 Validation Accuracy: 0.823000 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1256 Validation Accuracy: 0.783400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1224 Validation Accuracy: 0.813200 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1416 Validation Accuracy: 0.814200 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0713 Validation Accuracy: 0.823000 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0799 Validation Accuracy: 0.844600 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1291 Validation Accuracy: 0.804400 Epoch 55, CIFAR-10 Batch 3: Loss: 0.1176 Validation Accuracy: 0.809200 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1409 Validation Accuracy: 0.841000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0700 Validation Accuracy: 0.793200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0805 Validation Accuracy: 0.818200 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1198 Validation Accuracy: 0.827000 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1085 Validation Accuracy: 0.798600 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1342 Validation Accuracy: 0.820000 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0657 Validation Accuracy: 0.810800 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0749 Validation Accuracy: 0.837800 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1185 Validation Accuracy: 0.812600 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1036 Validation Accuracy: 0.799800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1180 Validation Accuracy: 0.812000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0702 Validation Accuracy: 0.802200 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0771 Validation Accuracy: 0.843000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.1251 Validation Accuracy: 0.803600 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0999 Validation Accuracy: 0.814200 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1219 Validation Accuracy: 0.812800 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0606 Validation Accuracy: 0.800800 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0791 Validation Accuracy: 0.825800 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1066 Validation Accuracy: 0.807200 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1000 Validation Accuracy: 0.804000 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1147 Validation Accuracy: 0.823800 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0625 Validation Accuracy: 0.829200 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0648 Validation Accuracy: 0.843800 Epoch 60, CIFAR-10 Batch 2: Loss: 0.1050 Validation Accuracy: 0.811800 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1055 Validation Accuracy: 0.809800 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1056 Validation Accuracy: 0.823800 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0587 Validation Accuracy: 0.803200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0639 Validation Accuracy: 0.822200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1111 Validation Accuracy: 0.815800 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1024 Validation Accuracy: 0.808400 Epoch 61, CIFAR-10 Batch 4: Loss: 0.1074 Validation Accuracy: 0.839000 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0555 Validation Accuracy: 0.820200 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0627 Validation Accuracy: 0.837000 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1085 Validation Accuracy: 0.799000 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0914 Validation Accuracy: 0.826800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.1032 Validation Accuracy: 0.823200 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0537 Validation Accuracy: 0.829400 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0659 Validation Accuracy: 0.835400 Epoch 63, CIFAR-10 Batch 2: Loss: 0.1032 Validation Accuracy: 0.826200 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0918 Validation Accuracy: 0.837400 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0953 Validation Accuracy: 0.839600 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0550 Validation Accuracy: 0.825600 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0664 Validation Accuracy: 0.834000 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0964 Validation Accuracy: 0.816000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0846 Validation Accuracy: 0.815800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0933 Validation Accuracy: 0.827200 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0552 Validation Accuracy: 0.833400 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0598 Validation Accuracy: 0.837200 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0931 Validation Accuracy: 0.806200 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0833 Validation Accuracy: 0.806000 Epoch 65, CIFAR-10 Batch 4: Loss: 0.1002 Validation Accuracy: 0.839600 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0544 Validation Accuracy: 0.825800 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0590 Validation Accuracy: 0.841000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0952 Validation Accuracy: 0.829000 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0779 Validation Accuracy: 0.808800 Epoch 66, CIFAR-10 Batch 4: Loss: 0.1007 Validation Accuracy: 0.826400 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0513 Validation Accuracy: 0.811400 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0556 Validation Accuracy: 0.837800 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0854 Validation Accuracy: 0.802000 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0772 Validation Accuracy: 0.815800 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0853 Validation Accuracy: 0.838000 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0550 Validation Accuracy: 0.824000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0528 Validation Accuracy: 0.821400 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0858 Validation Accuracy: 0.805600 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0729 Validation Accuracy: 0.831200 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0783 Validation Accuracy: 0.837000 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0513 Validation Accuracy: 0.819400 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0532 Validation Accuracy: 0.835800 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0837 Validation Accuracy: 0.820200 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0744 Validation Accuracy: 0.811400 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0807 Validation Accuracy: 0.849600 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0520 Validation Accuracy: 0.824400 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0537 Validation Accuracy: 0.833600 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0843 Validation Accuracy: 0.808600 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0753 Validation Accuracy: 0.825400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0811 Validation Accuracy: 0.840200 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0489 Validation Accuracy: 0.815000 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0502 Validation Accuracy: 0.847200 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0774 Validation Accuracy: 0.812200 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0770 Validation Accuracy: 0.822800 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0757 Validation Accuracy: 0.842400 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0458 Validation Accuracy: 0.812200 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0496 Validation Accuracy: 0.851200 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0800 Validation Accuracy: 0.827000 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0716 Validation Accuracy: 0.826600 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0715 Validation Accuracy: 0.833800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0478 Validation Accuracy: 0.809200 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0438 Validation Accuracy: 0.832800 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0770 Validation Accuracy: 0.821000 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0656 Validation Accuracy: 0.816000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0726 Validation Accuracy: 0.832600 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0472 Validation Accuracy: 0.814400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0474 Validation Accuracy: 0.835800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0776 Validation Accuracy: 0.798600 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0694 Validation Accuracy: 0.826800 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0639 Validation Accuracy: 0.821000 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0460 Validation Accuracy: 0.822600 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0488 Validation Accuracy: 0.836400 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0756 Validation Accuracy: 0.815200 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0667 Validation Accuracy: 0.807600 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0648 Validation Accuracy: 0.837400 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0454 Validation Accuracy: 0.810600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0421 Validation Accuracy: 0.845000 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0725 Validation Accuracy: 0.824000 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0616 Validation Accuracy: 0.823600 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0631 Validation Accuracy: 0.825600 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0435 Validation Accuracy: 0.809400 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0444 Validation Accuracy: 0.837400 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0675 Validation Accuracy: 0.807000 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0601 Validation Accuracy: 0.830200 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0672 Validation Accuracy: 0.827200 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0420 Validation Accuracy: 0.814400 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0439 Validation Accuracy: 0.830600 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0674 Validation Accuracy: 0.823400 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0626 Validation Accuracy: 0.825800 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0611 Validation Accuracy: 0.836200 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0430 Validation Accuracy: 0.818800 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0426 Validation Accuracy: 0.852800 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0640 Validation Accuracy: 0.819000 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0639 Validation Accuracy: 0.828200 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0638 Validation Accuracy: 0.820800 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0437 Validation Accuracy: 0.818200 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0438 Validation Accuracy: 0.819400 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0682 Validation Accuracy: 0.837200 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0605 Validation Accuracy: 0.817800 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0578 Validation Accuracy: 0.817800 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0426 Validation Accuracy: 0.845800 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0433 Validation Accuracy: 0.817200 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0702 Validation Accuracy: 0.807000 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0565 Validation Accuracy: 0.814200 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0603 Validation Accuracy: 0.845800 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0408 Validation Accuracy: 0.828400 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0400 Validation Accuracy: 0.849600 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0630 Validation Accuracy: 0.853400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0646 Validation Accuracy: 0.851800 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0508 Validation Accuracy: 0.855800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0404 Validation Accuracy: 0.856000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0387 Validation Accuracy: 0.855000 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0615 Validation Accuracy: 0.857800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.858000 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.858200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856200 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857800 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.858000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858400 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.858000 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857400 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857400 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.858000 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857400 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857000 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856000 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856000 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857400 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857800 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857400 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857200 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.856800 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.858000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857000 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857600 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856600 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856600 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.857000 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857600 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856000 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857600 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.857000 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857400 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857400 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857000 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858200 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857200 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856800 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.857200 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857800 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856200 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.857000 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.856800 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857600 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857000 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0385 Validation Accuracy: 0.856400 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.856800 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0607 Validation Accuracy: 0.858000 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0506 Validation Accuracy: 0.857400 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0403 Validation Accuracy: 0.857400 Training for learning_rate=0.10000, batch_size=64 ... Epoch 1, CIFAR-10 Batch 1: Loss: 2.1690 Validation Accuracy: 0.109200 Epoch 1, CIFAR-10 Batch 2: Loss: 2.1891 Validation Accuracy: 0.164600 Epoch 1, CIFAR-10 Batch 3: Loss: 2.1643 Validation Accuracy: 0.101200 Epoch 1, CIFAR-10 Batch 4: Loss: 2.1197 Validation Accuracy: 0.125800 Epoch 1, CIFAR-10 Batch 5: Loss: 2.0440 Validation Accuracy: 0.100200 Epoch 2, CIFAR-10 Batch 1: Loss: 1.9230 Validation Accuracy: 0.139400 Epoch 2, CIFAR-10 Batch 2: Loss: 2.0019 Validation Accuracy: 0.151800 Epoch 2, CIFAR-10 Batch 3: Loss: 1.8569 Validation Accuracy: 0.202600 Epoch 2, CIFAR-10 Batch 4: Loss: 1.8524 Validation Accuracy: 0.228400 Epoch 2, CIFAR-10 Batch 5: Loss: 1.8713 Validation Accuracy: 0.237600 Epoch 3, CIFAR-10 Batch 1: Loss: 1.7940 Validation Accuracy: 0.200000 Epoch 3, CIFAR-10 Batch 2: Loss: 1.9010 Validation Accuracy: 0.192800 Epoch 3, CIFAR-10 Batch 3: Loss: 1.8330 Validation Accuracy: 0.295800 Epoch 3, CIFAR-10 Batch 4: Loss: 1.8289 Validation Accuracy: 0.347600 Epoch 3, CIFAR-10 Batch 5: Loss: 1.8103 Validation Accuracy: 0.212800 Epoch 4, CIFAR-10 Batch 1: Loss: 1.6946 Validation Accuracy: 0.336400 Epoch 4, CIFAR-10 Batch 2: Loss: 1.9634 Validation Accuracy: 0.164600 Epoch 4, CIFAR-10 Batch 3: Loss: 1.6841 Validation Accuracy: 0.284400 Epoch 4, CIFAR-10 Batch 4: Loss: 1.6817 Validation Accuracy: 0.221400 Epoch 4, CIFAR-10 Batch 5: Loss: 1.7413 Validation Accuracy: 0.177200 Epoch 5, CIFAR-10 Batch 1: Loss: 1.6495 Validation Accuracy: 0.297000 Epoch 5, CIFAR-10 Batch 2: Loss: 1.9034 Validation Accuracy: 0.304400 Epoch 5, CIFAR-10 Batch 3: Loss: 1.6721 Validation Accuracy: 0.266600 Epoch 5, CIFAR-10 Batch 4: Loss: 1.6996 Validation Accuracy: 0.227200 Epoch 5, CIFAR-10 Batch 5: Loss: 1.7211 Validation Accuracy: 0.389000 Epoch 6, CIFAR-10 Batch 1: Loss: 1.6315 Validation Accuracy: 0.390400 Epoch 6, CIFAR-10 Batch 2: Loss: 1.8072 Validation Accuracy: 0.419800 Epoch 6, CIFAR-10 Batch 3: Loss: 1.6772 Validation Accuracy: 0.407000 Epoch 6, CIFAR-10 Batch 4: Loss: 1.6602 Validation Accuracy: 0.223200 Epoch 6, CIFAR-10 Batch 5: Loss: 1.6752 Validation Accuracy: 0.336000 Epoch 7, CIFAR-10 Batch 1: Loss: 1.5884 Validation Accuracy: 0.421600 Epoch 7, CIFAR-10 Batch 2: Loss: 1.8294 Validation Accuracy: 0.292600 Epoch 7, CIFAR-10 Batch 3: Loss: 1.5674 Validation Accuracy: 0.404400 Epoch 7, CIFAR-10 Batch 4: Loss: 1.6375 Validation Accuracy: 0.359400 Epoch 7, CIFAR-10 Batch 5: Loss: 1.5069 Validation Accuracy: 0.322400 Epoch 8, CIFAR-10 Batch 1: Loss: 1.6283 Validation Accuracy: 0.406600 Epoch 8, CIFAR-10 Batch 2: Loss: 1.7717 Validation Accuracy: 0.407800 Epoch 8, CIFAR-10 Batch 3: Loss: 1.5637 Validation Accuracy: 0.354000 Epoch 8, CIFAR-10 Batch 4: Loss: 1.6390 Validation Accuracy: 0.452800 Epoch 8, CIFAR-10 Batch 5: Loss: 1.5192 Validation Accuracy: 0.352000 Epoch 9, CIFAR-10 Batch 1: Loss: 1.6576 Validation Accuracy: 0.408000 Epoch 9, CIFAR-10 Batch 2: Loss: 1.7435 Validation Accuracy: 0.351600 Epoch 9, CIFAR-10 Batch 3: Loss: 1.5988 Validation Accuracy: 0.376400 Epoch 9, CIFAR-10 Batch 4: Loss: 1.6100 Validation Accuracy: 0.417800 Epoch 9, CIFAR-10 Batch 5: Loss: 1.5829 Validation Accuracy: 0.352800 Epoch 10, CIFAR-10 Batch 1: Loss: 1.6447 Validation Accuracy: 0.361000 Epoch 10, CIFAR-10 Batch 2: Loss: 1.6268 Validation Accuracy: 0.294200 Epoch 10, CIFAR-10 Batch 3: Loss: 1.6381 Validation Accuracy: 0.256800 Epoch 10, CIFAR-10 Batch 4: Loss: 1.5605 Validation Accuracy: 0.429400 Epoch 10, CIFAR-10 Batch 5: Loss: 1.6310 Validation Accuracy: 0.432800 Epoch 11, CIFAR-10 Batch 1: Loss: 1.5902 Validation Accuracy: 0.334400 Epoch 11, CIFAR-10 Batch 2: Loss: 1.6760 Validation Accuracy: 0.462800 Epoch 11, CIFAR-10 Batch 3: Loss: 1.5150 Validation Accuracy: 0.368200 Epoch 11, CIFAR-10 Batch 4: Loss: 1.5401 Validation Accuracy: 0.457600 Epoch 11, CIFAR-10 Batch 5: Loss: 1.6368 Validation Accuracy: 0.436000 Epoch 12, CIFAR-10 Batch 1: Loss: 1.5992 Validation Accuracy: 0.454600 Epoch 12, CIFAR-10 Batch 2: Loss: 1.6496 Validation Accuracy: 0.387200 Epoch 12, CIFAR-10 Batch 3: Loss: 1.5820 Validation Accuracy: 0.404400 Epoch 12, CIFAR-10 Batch 4: Loss: 1.5951 Validation Accuracy: 0.405000 Epoch 12, CIFAR-10 Batch 5: Loss: 1.4963 Validation Accuracy: 0.422800 Epoch 13, CIFAR-10 Batch 1: Loss: 1.6730 Validation Accuracy: 0.286400 Epoch 13, CIFAR-10 Batch 2: Loss: 1.7218 Validation Accuracy: 0.410400 Epoch 13, CIFAR-10 Batch 3: Loss: 1.4559 Validation Accuracy: 0.432400 Epoch 13, CIFAR-10 Batch 4: Loss: 1.5520 Validation Accuracy: 0.388600 Epoch 13, CIFAR-10 Batch 5: Loss: 1.5618 Validation Accuracy: 0.329600 Epoch 14, CIFAR-10 Batch 1: Loss: 1.6186 Validation Accuracy: 0.452200 Epoch 14, CIFAR-10 Batch 2: Loss: 1.5862 Validation Accuracy: 0.305400 Epoch 14, CIFAR-10 Batch 3: Loss: 1.5004 Validation Accuracy: 0.416800 Epoch 14, CIFAR-10 Batch 4: Loss: 1.5267 Validation Accuracy: 0.432600 Epoch 14, CIFAR-10 Batch 5: Loss: 1.5249 Validation Accuracy: 0.410200 Epoch 15, CIFAR-10 Batch 1: Loss: 1.6263 Validation Accuracy: 0.377800 Epoch 15, CIFAR-10 Batch 2: Loss: 1.6090 Validation Accuracy: 0.469400 Epoch 15, CIFAR-10 Batch 3: Loss: 1.5073 Validation Accuracy: 0.300400 Epoch 15, CIFAR-10 Batch 4: Loss: 1.5396 Validation Accuracy: 0.364000 Epoch 15, CIFAR-10 Batch 5: Loss: 1.4878 Validation Accuracy: 0.429000 Epoch 16, CIFAR-10 Batch 1: Loss: 1.5734 Validation Accuracy: 0.437400 Epoch 16, CIFAR-10 Batch 2: Loss: 1.5239 Validation Accuracy: 0.457800 Epoch 16, CIFAR-10 Batch 3: Loss: 1.4238 Validation Accuracy: 0.419600 Epoch 16, CIFAR-10 Batch 4: Loss: 1.5685 Validation Accuracy: 0.444600 Epoch 16, CIFAR-10 Batch 5: Loss: 1.5578 Validation Accuracy: 0.338400 Epoch 17, CIFAR-10 Batch 1: Loss: 1.5542 Validation Accuracy: 0.361200 Epoch 17, CIFAR-10 Batch 2: Loss: 1.5274 Validation Accuracy: 0.473400 Epoch 17, CIFAR-10 Batch 3: Loss: 1.5656 Validation Accuracy: 0.237000 Epoch 17, CIFAR-10 Batch 4: Loss: 1.5491 Validation Accuracy: 0.401200 Epoch 17, CIFAR-10 Batch 5: Loss: 1.4626 Validation Accuracy: 0.279000 Epoch 18, CIFAR-10 Batch 1: Loss: 1.5773 Validation Accuracy: 0.426200 Epoch 18, CIFAR-10 Batch 2: Loss: 1.4909 Validation Accuracy: 0.369800 Epoch 18, CIFAR-10 Batch 3: Loss: 1.4787 Validation Accuracy: 0.378800 Epoch 18, CIFAR-10 Batch 4: Loss: 1.4823 Validation Accuracy: 0.431200 Epoch 18, CIFAR-10 Batch 5: Loss: 1.4591 Validation Accuracy: 0.343800 Epoch 19, CIFAR-10 Batch 1: Loss: 1.5957 Validation Accuracy: 0.351200 Epoch 19, CIFAR-10 Batch 2: Loss: 1.5274 Validation Accuracy: 0.335200 Epoch 19, CIFAR-10 Batch 3: Loss: 1.4315 Validation Accuracy: 0.407600 Epoch 19, CIFAR-10 Batch 4: Loss: 1.5247 Validation Accuracy: 0.425800 Epoch 19, CIFAR-10 Batch 5: Loss: 1.5393 Validation Accuracy: 0.373000 Epoch 20, CIFAR-10 Batch 1: Loss: 1.5608 Validation Accuracy: 0.386800 Epoch 20, CIFAR-10 Batch 2: Loss: 1.4608 Validation Accuracy: 0.449000 Epoch 20, CIFAR-10 Batch 3: Loss: 1.3928 Validation Accuracy: 0.434400 Epoch 20, CIFAR-10 Batch 4: Loss: 1.4762 Validation Accuracy: 0.448200 Epoch 20, CIFAR-10 Batch 5: Loss: 1.5132 Validation Accuracy: 0.441600 Epoch 21, CIFAR-10 Batch 1: Loss: 1.5693 Validation Accuracy: 0.329200 Epoch 21, CIFAR-10 Batch 2: Loss: 1.5366 Validation Accuracy: 0.403600 Epoch 21, CIFAR-10 Batch 3: Loss: 1.4448 Validation Accuracy: 0.475600 Epoch 21, CIFAR-10 Batch 4: Loss: 1.5700 Validation Accuracy: 0.449000 Epoch 21, CIFAR-10 Batch 5: Loss: 1.5201 Validation Accuracy: 0.412000 Epoch 22, CIFAR-10 Batch 1: Loss: 1.5876 Validation Accuracy: 0.346400 Epoch 22, CIFAR-10 Batch 2: Loss: 1.5505 Validation Accuracy: 0.406800 Epoch 22, CIFAR-10 Batch 3: Loss: 1.4640 Validation Accuracy: 0.425200 Epoch 22, CIFAR-10 Batch 4: Loss: 1.5520 Validation Accuracy: 0.442400 Epoch 22, CIFAR-10 Batch 5: Loss: 1.4405 Validation Accuracy: 0.425600 Epoch 23, CIFAR-10 Batch 1: Loss: 1.5987 Validation Accuracy: 0.381800 Epoch 23, CIFAR-10 Batch 2: Loss: 1.5021 Validation Accuracy: 0.417000 Epoch 23, CIFAR-10 Batch 3: Loss: 1.4351 Validation Accuracy: 0.436000 Epoch 23, CIFAR-10 Batch 4: Loss: 1.4709 Validation Accuracy: 0.353200 Epoch 23, CIFAR-10 Batch 5: Loss: 1.5095 Validation Accuracy: 0.406000 Epoch 24, CIFAR-10 Batch 1: Loss: 1.6559 Validation Accuracy: 0.467600 Epoch 24, CIFAR-10 Batch 2: Loss: 1.4365 Validation Accuracy: 0.463600 Epoch 24, CIFAR-10 Batch 3: Loss: 1.4277 Validation Accuracy: 0.388400 Epoch 24, CIFAR-10 Batch 4: Loss: 1.4901 Validation Accuracy: 0.468800 Epoch 24, CIFAR-10 Batch 5: Loss: 1.5774 Validation Accuracy: 0.428600 Epoch 25, CIFAR-10 Batch 1: Loss: 1.5017 Validation Accuracy: 0.373400 Epoch 25, CIFAR-10 Batch 2: Loss: 1.5270 Validation Accuracy: 0.319800 Epoch 25, CIFAR-10 Batch 3: Loss: 1.3565 Validation Accuracy: 0.458200 Epoch 25, CIFAR-10 Batch 4: Loss: 1.5802 Validation Accuracy: 0.363000 Epoch 25, CIFAR-10 Batch 5: Loss: 1.4888 Validation Accuracy: 0.480000 Epoch 26, CIFAR-10 Batch 1: Loss: 1.5566 Validation Accuracy: 0.399400 Epoch 26, CIFAR-10 Batch 2: Loss: 1.4293 Validation Accuracy: 0.271200 Epoch 26, CIFAR-10 Batch 3: Loss: 1.4226 Validation Accuracy: 0.366000 Epoch 26, CIFAR-10 Batch 4: Loss: 1.5563 Validation Accuracy: 0.373600 Epoch 26, CIFAR-10 Batch 5: Loss: 1.4599 Validation Accuracy: 0.349000 Epoch 27, CIFAR-10 Batch 1: Loss: 1.5179 Validation Accuracy: 0.414800 Epoch 27, CIFAR-10 Batch 2: Loss: 1.4642 Validation Accuracy: 0.436400 Epoch 27, CIFAR-10 Batch 3: Loss: 1.3780 Validation Accuracy: 0.417200 Epoch 27, CIFAR-10 Batch 4: Loss: 1.5513 Validation Accuracy: 0.410000 Epoch 27, CIFAR-10 Batch 5: Loss: 1.4889 Validation Accuracy: 0.409400 Epoch 28, CIFAR-10 Batch 1: Loss: 1.5818 Validation Accuracy: 0.445800 Epoch 28, CIFAR-10 Batch 2: Loss: 1.4565 Validation Accuracy: 0.461200 Epoch 28, CIFAR-10 Batch 3: Loss: 1.4106 Validation Accuracy: 0.403400 Epoch 28, CIFAR-10 Batch 4: Loss: 1.4906 Validation Accuracy: 0.390600 Epoch 28, CIFAR-10 Batch 5: Loss: 1.4672 Validation Accuracy: 0.471000 Epoch 29, CIFAR-10 Batch 1: Loss: 1.6072 Validation Accuracy: 0.456400 Epoch 29, CIFAR-10 Batch 2: Loss: 1.5178 Validation Accuracy: 0.455200 Epoch 29, CIFAR-10 Batch 3: Loss: 1.3675 Validation Accuracy: 0.366000 Epoch 29, CIFAR-10 Batch 4: Loss: 1.5357 Validation Accuracy: 0.426200 Epoch 29, CIFAR-10 Batch 5: Loss: 1.5320 Validation Accuracy: 0.458200 Epoch 30, CIFAR-10 Batch 1: Loss: 1.6229 Validation Accuracy: 0.415800 Epoch 30, CIFAR-10 Batch 2: Loss: 1.5089 Validation Accuracy: 0.487200 Epoch 30, CIFAR-10 Batch 3: Loss: 1.4146 Validation Accuracy: 0.416400 Epoch 30, CIFAR-10 Batch 4: Loss: 1.5409 Validation Accuracy: 0.413200 Epoch 30, CIFAR-10 Batch 5: Loss: 1.5364 Validation Accuracy: 0.361600 Epoch 31, CIFAR-10 Batch 1: Loss: 1.6043 Validation Accuracy: 0.419400 Epoch 31, CIFAR-10 Batch 2: Loss: 1.5381 Validation Accuracy: 0.450000 Epoch 31, CIFAR-10 Batch 3: Loss: 1.4307 Validation Accuracy: 0.457800 Epoch 31, CIFAR-10 Batch 4: Loss: 1.5041 Validation Accuracy: 0.432600 Epoch 31, CIFAR-10 Batch 5: Loss: 1.4973 Validation Accuracy: 0.370400 Epoch 32, CIFAR-10 Batch 1: Loss: 1.5230 Validation Accuracy: 0.428800 Epoch 32, CIFAR-10 Batch 2: Loss: 1.5408 Validation Accuracy: 0.404400 Epoch 32, CIFAR-10 Batch 3: Loss: 1.4805 Validation Accuracy: 0.368600 Epoch 32, CIFAR-10 Batch 4: Loss: 1.4678 Validation Accuracy: 0.425400 Epoch 32, CIFAR-10 Batch 5: Loss: 1.6033 Validation Accuracy: 0.310000 Epoch 33, CIFAR-10 Batch 1: Loss: 1.5809 Validation Accuracy: 0.380200 Epoch 33, CIFAR-10 Batch 2: Loss: 1.5181 Validation Accuracy: 0.506000 Epoch 33, CIFAR-10 Batch 3: Loss: 1.3878 Validation Accuracy: 0.445400 Epoch 33, CIFAR-10 Batch 4: Loss: 1.4428 Validation Accuracy: 0.460200 Epoch 33, CIFAR-10 Batch 5: Loss: 1.4486 Validation Accuracy: 0.386600 Epoch 34, CIFAR-10 Batch 1: Loss: 1.5778 Validation Accuracy: 0.398000 Epoch 34, CIFAR-10 Batch 2: Loss: 1.5063 Validation Accuracy: 0.325200 Epoch 34, CIFAR-10 Batch 3: Loss: 1.4057 Validation Accuracy: 0.376400 Epoch 34, CIFAR-10 Batch 4: Loss: 1.5185 Validation Accuracy: 0.403600 Epoch 34, CIFAR-10 Batch 5: Loss: 1.5126 Validation Accuracy: 0.178800 Epoch 35, CIFAR-10 Batch 1: Loss: 1.6023 Validation Accuracy: 0.383600 Epoch 35, CIFAR-10 Batch 2: Loss: 1.4246 Validation Accuracy: 0.498000 Epoch 35, CIFAR-10 Batch 3: Loss: 1.4689 Validation Accuracy: 0.441600 Epoch 35, CIFAR-10 Batch 4: Loss: 1.4697 Validation Accuracy: 0.394800 Epoch 35, CIFAR-10 Batch 5: Loss: 1.4735 Validation Accuracy: 0.456400 Epoch 36, CIFAR-10 Batch 1: Loss: 1.5302 Validation Accuracy: 0.468200 Epoch 36, CIFAR-10 Batch 2: Loss: 1.4475 Validation Accuracy: 0.488000 Epoch 36, CIFAR-10 Batch 3: Loss: 1.3653 Validation Accuracy: 0.433600 Epoch 36, CIFAR-10 Batch 4: Loss: 1.5163 Validation Accuracy: 0.417800 Epoch 36, CIFAR-10 Batch 5: Loss: 1.5455 Validation Accuracy: 0.493800 Epoch 37, CIFAR-10 Batch 1: Loss: 1.5496 Validation Accuracy: 0.486200 Epoch 37, CIFAR-10 Batch 2: Loss: 1.4740 Validation Accuracy: 0.429000 Epoch 37, CIFAR-10 Batch 3: Loss: 1.3784 Validation Accuracy: 0.477200 Epoch 37, CIFAR-10 Batch 4: Loss: 1.4505 Validation Accuracy: 0.431000 Epoch 37, CIFAR-10 Batch 5: Loss: 1.5020 Validation Accuracy: 0.451600 Epoch 38, CIFAR-10 Batch 1: Loss: 1.5338 Validation Accuracy: 0.452800 Epoch 38, CIFAR-10 Batch 2: Loss: 1.4762 Validation Accuracy: 0.485800 Epoch 38, CIFAR-10 Batch 3: Loss: 1.4113 Validation Accuracy: 0.433400 Epoch 38, CIFAR-10 Batch 4: Loss: 1.4387 Validation Accuracy: 0.456000 Epoch 38, CIFAR-10 Batch 5: Loss: 1.5150 Validation Accuracy: 0.415000 Epoch 39, CIFAR-10 Batch 1: Loss: 1.4998 Validation Accuracy: 0.480000 Epoch 39, CIFAR-10 Batch 2: Loss: 1.5356 Validation Accuracy: 0.343200 Epoch 39, CIFAR-10 Batch 3: Loss: 1.3602 Validation Accuracy: 0.460800 Epoch 39, CIFAR-10 Batch 4: Loss: 1.5179 Validation Accuracy: 0.411200 Epoch 39, CIFAR-10 Batch 5: Loss: 1.4662 Validation Accuracy: 0.289600 Epoch 40, CIFAR-10 Batch 1: Loss: 1.5520 Validation Accuracy: 0.462200 Epoch 40, CIFAR-10 Batch 2: Loss: 1.4788 Validation Accuracy: 0.416800 Epoch 40, CIFAR-10 Batch 3: Loss: 1.3553 Validation Accuracy: 0.412400 Epoch 40, CIFAR-10 Batch 4: Loss: 1.4835 Validation Accuracy: 0.445600 Epoch 40, CIFAR-10 Batch 5: Loss: 1.4765 Validation Accuracy: 0.403400 Epoch 41, CIFAR-10 Batch 1: Loss: 1.6023 Validation Accuracy: 0.474200 Epoch 41, CIFAR-10 Batch 2: Loss: 1.5187 Validation Accuracy: 0.463000 Epoch 41, CIFAR-10 Batch 3: Loss: 1.3887 Validation Accuracy: 0.477000 Epoch 41, CIFAR-10 Batch 4: Loss: 1.4164 Validation Accuracy: 0.392200 Epoch 41, CIFAR-10 Batch 5: Loss: 1.4689 Validation Accuracy: 0.368200 Epoch 42, CIFAR-10 Batch 1: Loss: 1.5240 Validation Accuracy: 0.436600 Epoch 42, CIFAR-10 Batch 2: Loss: 1.4743 Validation Accuracy: 0.466200 Epoch 42, CIFAR-10 Batch 3: Loss: 1.4356 Validation Accuracy: 0.464400 Epoch 42, CIFAR-10 Batch 4: Loss: 1.4482 Validation Accuracy: 0.418000 Epoch 42, CIFAR-10 Batch 5: Loss: 1.4608 Validation Accuracy: 0.421800 Epoch 43, CIFAR-10 Batch 1: Loss: 1.4881 Validation Accuracy: 0.438400 Epoch 43, CIFAR-10 Batch 2: Loss: 1.4288 Validation Accuracy: 0.485000 Epoch 43, CIFAR-10 Batch 3: Loss: 1.3393 Validation Accuracy: 0.479400 Epoch 43, CIFAR-10 Batch 4: Loss: 1.4192 Validation Accuracy: 0.506200 Epoch 43, CIFAR-10 Batch 5: Loss: 1.3497 Validation Accuracy: 0.462400 Epoch 44, CIFAR-10 Batch 1: Loss: 1.4679 Validation Accuracy: 0.377600 Epoch 44, CIFAR-10 Batch 2: Loss: 1.4600 Validation Accuracy: 0.375800 Epoch 44, CIFAR-10 Batch 3: Loss: 1.3736 Validation Accuracy: 0.477400 Epoch 44, CIFAR-10 Batch 4: Loss: 1.4472 Validation Accuracy: 0.357800 Epoch 44, CIFAR-10 Batch 5: Loss: 1.4624 Validation Accuracy: 0.470600 Epoch 45, CIFAR-10 Batch 1: Loss: 1.5663 Validation Accuracy: 0.379000 Epoch 45, CIFAR-10 Batch 2: Loss: 1.5070 Validation Accuracy: 0.455200 Epoch 45, CIFAR-10 Batch 3: Loss: 1.4064 Validation Accuracy: 0.504000 Epoch 45, CIFAR-10 Batch 4: Loss: 1.4619 Validation Accuracy: 0.454000 Epoch 45, CIFAR-10 Batch 5: Loss: 1.5069 Validation Accuracy: 0.466200 Epoch 46, CIFAR-10 Batch 1: Loss: 1.5190 Validation Accuracy: 0.481600 Epoch 46, CIFAR-10 Batch 2: Loss: 1.4070 Validation Accuracy: 0.390400 Epoch 46, CIFAR-10 Batch 3: Loss: 1.3254 Validation Accuracy: 0.464400 Epoch 46, CIFAR-10 Batch 4: Loss: 1.5829 Validation Accuracy: 0.395000 Epoch 46, CIFAR-10 Batch 5: Loss: 1.4263 Validation Accuracy: 0.499200 Epoch 47, CIFAR-10 Batch 1: Loss: 1.5138 Validation Accuracy: 0.334200 Epoch 47, CIFAR-10 Batch 2: Loss: 1.4282 Validation Accuracy: 0.463400 Epoch 47, CIFAR-10 Batch 3: Loss: 1.3165 Validation Accuracy: 0.398600 Epoch 47, CIFAR-10 Batch 4: Loss: 1.5038 Validation Accuracy: 0.458800 Epoch 47, CIFAR-10 Batch 5: Loss: 1.4068 Validation Accuracy: 0.462600 Epoch 48, CIFAR-10 Batch 1: Loss: 1.5191 Validation Accuracy: 0.452800 Epoch 48, CIFAR-10 Batch 2: Loss: 1.3915 Validation Accuracy: 0.479000 Epoch 48, CIFAR-10 Batch 3: Loss: 1.3304 Validation Accuracy: 0.493000 Epoch 48, CIFAR-10 Batch 4: Loss: 1.4444 Validation Accuracy: 0.436200 Epoch 48, CIFAR-10 Batch 5: Loss: 1.4411 Validation Accuracy: 0.484600 Epoch 49, CIFAR-10 Batch 1: Loss: 1.5286 Validation Accuracy: 0.355800 Epoch 49, CIFAR-10 Batch 2: Loss: 1.4010 Validation Accuracy: 0.465600 Epoch 49, CIFAR-10 Batch 3: Loss: 1.3043 Validation Accuracy: 0.373200 Epoch 49, CIFAR-10 Batch 4: Loss: 1.4637 Validation Accuracy: 0.418600 Epoch 49, CIFAR-10 Batch 5: Loss: 1.4226 Validation Accuracy: 0.407600 Epoch 50, CIFAR-10 Batch 1: Loss: 1.5451 Validation Accuracy: 0.313400 Epoch 50, CIFAR-10 Batch 2: Loss: 1.4659 Validation Accuracy: 0.477600 Epoch 50, CIFAR-10 Batch 3: Loss: 1.2961 Validation Accuracy: 0.470400 Epoch 50, CIFAR-10 Batch 4: Loss: 1.4637 Validation Accuracy: 0.478000 Epoch 50, CIFAR-10 Batch 5: Loss: 1.4750 Validation Accuracy: 0.472600 Epoch 51, CIFAR-10 Batch 1: Loss: 1.5724 Validation Accuracy: 0.495600 Epoch 51, CIFAR-10 Batch 2: Loss: 1.4222 Validation Accuracy: 0.488800 Epoch 51, CIFAR-10 Batch 3: Loss: 1.3025 Validation Accuracy: 0.468400 Epoch 51, CIFAR-10 Batch 4: Loss: 1.4621 Validation Accuracy: 0.406800 Epoch 51, CIFAR-10 Batch 5: Loss: 1.4985 Validation Accuracy: 0.390200 Epoch 52, CIFAR-10 Batch 1: Loss: 1.4715 Validation Accuracy: 0.490000 Epoch 52, CIFAR-10 Batch 2: Loss: 1.4622 Validation Accuracy: 0.383400 Epoch 52, CIFAR-10 Batch 3: Loss: 1.3178 Validation Accuracy: 0.420600 Epoch 52, CIFAR-10 Batch 4: Loss: 1.4483 Validation Accuracy: 0.455600 Epoch 52, CIFAR-10 Batch 5: Loss: 1.4131 Validation Accuracy: 0.503400 Epoch 53, CIFAR-10 Batch 1: Loss: 1.4561 Validation Accuracy: 0.374200 Epoch 53, CIFAR-10 Batch 2: Loss: 1.4207 Validation Accuracy: 0.447000 Epoch 53, CIFAR-10 Batch 3: Loss: 1.3082 Validation Accuracy: 0.500600 Epoch 53, CIFAR-10 Batch 4: Loss: 1.4128 Validation Accuracy: 0.507200 Epoch 53, CIFAR-10 Batch 5: Loss: 1.4353 Validation Accuracy: 0.425800 Epoch 54, CIFAR-10 Batch 1: Loss: 1.5079 Validation Accuracy: 0.388200 Epoch 54, CIFAR-10 Batch 2: Loss: 1.4937 Validation Accuracy: 0.495200 Epoch 54, CIFAR-10 Batch 3: Loss: 1.3123 Validation Accuracy: 0.407800 Epoch 54, CIFAR-10 Batch 4: Loss: 1.4749 Validation Accuracy: 0.248600 Epoch 54, CIFAR-10 Batch 5: Loss: 1.3998 Validation Accuracy: 0.473000 Epoch 55, CIFAR-10 Batch 1: Loss: 1.4858 Validation Accuracy: 0.425200 Epoch 55, CIFAR-10 Batch 2: Loss: 1.3966 Validation Accuracy: 0.481400 Epoch 55, CIFAR-10 Batch 3: Loss: 1.3173 Validation Accuracy: 0.437200 Epoch 55, CIFAR-10 Batch 4: Loss: 1.5370 Validation Accuracy: 0.461400 Epoch 55, CIFAR-10 Batch 5: Loss: 1.6237 Validation Accuracy: 0.429800 Epoch 56, CIFAR-10 Batch 1: Loss: 1.5759 Validation Accuracy: 0.375200 Epoch 56, CIFAR-10 Batch 2: Loss: 1.3155 Validation Accuracy: 0.458800 Epoch 56, CIFAR-10 Batch 3: Loss: 1.3415 Validation Accuracy: 0.412600 Epoch 56, CIFAR-10 Batch 4: Loss: 1.3919 Validation Accuracy: 0.483800 Epoch 56, CIFAR-10 Batch 5: Loss: 1.4008 Validation Accuracy: 0.484400 Epoch 57, CIFAR-10 Batch 1: Loss: 1.5622 Validation Accuracy: 0.478600 Epoch 57, CIFAR-10 Batch 2: Loss: 1.5937 Validation Accuracy: 0.495200 Epoch 57, CIFAR-10 Batch 3: Loss: 1.3504 Validation Accuracy: 0.445200 Epoch 57, CIFAR-10 Batch 4: Loss: 1.4258 Validation Accuracy: 0.402800 Epoch 57, CIFAR-10 Batch 5: Loss: 1.3499 Validation Accuracy: 0.406400 Epoch 58, CIFAR-10 Batch 1: Loss: 1.4735 Validation Accuracy: 0.427200 Epoch 58, CIFAR-10 Batch 2: Loss: 1.4881 Validation Accuracy: 0.452000 Epoch 58, CIFAR-10 Batch 3: Loss: 1.3120 Validation Accuracy: 0.416200 Epoch 58, CIFAR-10 Batch 4: Loss: 1.3877 Validation Accuracy: 0.466000 Epoch 58, CIFAR-10 Batch 5: Loss: 1.4511 Validation Accuracy: 0.429000 Epoch 59, CIFAR-10 Batch 1: Loss: 1.5005 Validation Accuracy: 0.367400 Epoch 59, CIFAR-10 Batch 2: Loss: 1.4011 Validation Accuracy: 0.464800 Epoch 59, CIFAR-10 Batch 3: Loss: 1.3282 Validation Accuracy: 0.479400 Epoch 59, CIFAR-10 Batch 4: Loss: 1.4211 Validation Accuracy: 0.456400 Epoch 59, CIFAR-10 Batch 5: Loss: 1.3742 Validation Accuracy: 0.492200 Epoch 60, CIFAR-10 Batch 1: Loss: 1.5294 Validation Accuracy: 0.436800 Epoch 60, CIFAR-10 Batch 2: Loss: 1.4624 Validation Accuracy: 0.487200 Epoch 60, CIFAR-10 Batch 3: Loss: 1.3098 Validation Accuracy: 0.487400 Epoch 60, CIFAR-10 Batch 4: Loss: 1.5235 Validation Accuracy: 0.468200 Epoch 60, CIFAR-10 Batch 5: Loss: 1.4413 Validation Accuracy: 0.402400 Epoch 61, CIFAR-10 Batch 1: Loss: 1.4829 Validation Accuracy: 0.400000 Epoch 61, CIFAR-10 Batch 2: Loss: 1.3887 Validation Accuracy: 0.473800 Epoch 61, CIFAR-10 Batch 3: Loss: 1.2836 Validation Accuracy: 0.446600 Epoch 61, CIFAR-10 Batch 4: Loss: 1.4053 Validation Accuracy: 0.490400 Epoch 61, CIFAR-10 Batch 5: Loss: 1.3995 Validation Accuracy: 0.456000 Epoch 62, CIFAR-10 Batch 1: Loss: 1.4851 Validation Accuracy: 0.500400 Epoch 62, CIFAR-10 Batch 2: Loss: 1.4738 Validation Accuracy: 0.403400 Epoch 62, CIFAR-10 Batch 3: Loss: 1.2193 Validation Accuracy: 0.459600 Epoch 62, CIFAR-10 Batch 4: Loss: 1.4420 Validation Accuracy: 0.441200 Epoch 62, CIFAR-10 Batch 5: Loss: 1.3289 Validation Accuracy: 0.436600 Epoch 63, CIFAR-10 Batch 1: Loss: 1.5484 Validation Accuracy: 0.496800 Epoch 63, CIFAR-10 Batch 2: Loss: 1.4034 Validation Accuracy: 0.496800 Epoch 63, CIFAR-10 Batch 3: Loss: 1.3613 Validation Accuracy: 0.453400 Epoch 63, CIFAR-10 Batch 4: Loss: 1.4359 Validation Accuracy: 0.468000 Epoch 63, CIFAR-10 Batch 5: Loss: 1.3662 Validation Accuracy: 0.466000 Epoch 64, CIFAR-10 Batch 1: Loss: 1.5161 Validation Accuracy: 0.447800 Epoch 64, CIFAR-10 Batch 2: Loss: 1.3923 Validation Accuracy: 0.462200 Epoch 64, CIFAR-10 Batch 3: Loss: 1.3193 Validation Accuracy: 0.474800 Epoch 64, CIFAR-10 Batch 4: Loss: 1.3737 Validation Accuracy: 0.483800 Epoch 64, CIFAR-10 Batch 5: Loss: 1.4188 Validation Accuracy: 0.478600 Epoch 65, CIFAR-10 Batch 1: Loss: 1.4708 Validation Accuracy: 0.434400 Epoch 65, CIFAR-10 Batch 2: Loss: 1.4212 Validation Accuracy: 0.522200 Epoch 65, CIFAR-10 Batch 3: Loss: 1.2614 Validation Accuracy: 0.357400 Epoch 65, CIFAR-10 Batch 4: Loss: 1.4815 Validation Accuracy: 0.494800 Epoch 65, CIFAR-10 Batch 5: Loss: 1.3151 Validation Accuracy: 0.445000 Epoch 66, CIFAR-10 Batch 1: Loss: 1.4454 Validation Accuracy: 0.493800 Epoch 66, CIFAR-10 Batch 2: Loss: 1.4351 Validation Accuracy: 0.475400 Epoch 66, CIFAR-10 Batch 3: Loss: 1.3280 Validation Accuracy: 0.422200 Epoch 66, CIFAR-10 Batch 4: Loss: 1.4049 Validation Accuracy: 0.454000 Epoch 66, CIFAR-10 Batch 5: Loss: 1.3962 Validation Accuracy: 0.476800 Epoch 67, CIFAR-10 Batch 1: Loss: 1.4368 Validation Accuracy: 0.489000 Epoch 67, CIFAR-10 Batch 2: Loss: 1.5232 Validation Accuracy: 0.495200 Epoch 67, CIFAR-10 Batch 3: Loss: 1.2945 Validation Accuracy: 0.428000 Epoch 67, CIFAR-10 Batch 4: Loss: 1.3906 Validation Accuracy: 0.458600 Epoch 67, CIFAR-10 Batch 5: Loss: 1.4104 Validation Accuracy: 0.396000 Epoch 68, CIFAR-10 Batch 1: Loss: 1.5573 Validation Accuracy: 0.475400 Epoch 68, CIFAR-10 Batch 2: Loss: 1.4421 Validation Accuracy: 0.501200 Epoch 68, CIFAR-10 Batch 3: Loss: 1.3366 Validation Accuracy: 0.391600 Epoch 68, CIFAR-10 Batch 4: Loss: 1.4009 Validation Accuracy: 0.489600 Epoch 68, CIFAR-10 Batch 5: Loss: 1.3862 Validation Accuracy: 0.457600 Epoch 69, CIFAR-10 Batch 1: Loss: 1.5926 Validation Accuracy: 0.363000 Epoch 69, CIFAR-10 Batch 2: Loss: 1.3824 Validation Accuracy: 0.470400 Epoch 69, CIFAR-10 Batch 3: Loss: 1.2739 Validation Accuracy: 0.270000 Epoch 69, CIFAR-10 Batch 4: Loss: 1.4281 Validation Accuracy: 0.464400 Epoch 69, CIFAR-10 Batch 5: Loss: 1.3628 Validation Accuracy: 0.475000 Epoch 70, CIFAR-10 Batch 1: Loss: 1.5664 Validation Accuracy: 0.400600 Epoch 70, CIFAR-10 Batch 2: Loss: 1.3843 Validation Accuracy: 0.324000 Epoch 70, CIFAR-10 Batch 3: Loss: 1.3336 Validation Accuracy: 0.486200 Epoch 70, CIFAR-10 Batch 4: Loss: 1.3806 Validation Accuracy: 0.510800 Epoch 70, CIFAR-10 Batch 5: Loss: 1.3106 Validation Accuracy: 0.496400 Epoch 71, CIFAR-10 Batch 1: Loss: 1.4869 Validation Accuracy: 0.467200 Epoch 71, CIFAR-10 Batch 2: Loss: 1.4556 Validation Accuracy: 0.492800 Epoch 71, CIFAR-10 Batch 3: Loss: 1.3406 Validation Accuracy: 0.405000 Epoch 71, CIFAR-10 Batch 4: Loss: 1.4301 Validation Accuracy: 0.497600 Epoch 71, CIFAR-10 Batch 5: Loss: 1.3468 Validation Accuracy: 0.483600 Epoch 72, CIFAR-10 Batch 1: Loss: 1.4604 Validation Accuracy: 0.423000 Epoch 72, CIFAR-10 Batch 2: Loss: 1.4445 Validation Accuracy: 0.484800 Epoch 72, CIFAR-10 Batch 3: Loss: 1.3540 Validation Accuracy: 0.463000 Epoch 72, CIFAR-10 Batch 4: Loss: 1.4087 Validation Accuracy: 0.446400 Epoch 72, CIFAR-10 Batch 5: Loss: 1.3265 Validation Accuracy: 0.448000 Epoch 73, CIFAR-10 Batch 1: Loss: 1.6140 Validation Accuracy: 0.401400 Epoch 73, CIFAR-10 Batch 2: Loss: 1.4156 Validation Accuracy: 0.435000 Epoch 73, CIFAR-10 Batch 3: Loss: 1.3492 Validation Accuracy: 0.477600 Epoch 73, CIFAR-10 Batch 4: Loss: 1.3803 Validation Accuracy: 0.452800 Epoch 73, CIFAR-10 Batch 5: Loss: 1.3581 Validation Accuracy: 0.480800 Epoch 74, CIFAR-10 Batch 1: Loss: 1.4633 Validation Accuracy: 0.472400 Epoch 74, CIFAR-10 Batch 2: Loss: 1.4233 Validation Accuracy: 0.512200 Epoch 74, CIFAR-10 Batch 3: Loss: 1.2289 Validation Accuracy: 0.506800 Epoch 74, CIFAR-10 Batch 4: Loss: 1.4102 Validation Accuracy: 0.471200 Epoch 74, CIFAR-10 Batch 5: Loss: 1.3068 Validation Accuracy: 0.349400 Epoch 75, CIFAR-10 Batch 1: Loss: 1.4753 Validation Accuracy: 0.450600 Epoch 75, CIFAR-10 Batch 2: Loss: 1.4280 Validation Accuracy: 0.479400 Epoch 75, CIFAR-10 Batch 3: Loss: 1.3209 Validation Accuracy: 0.466000 Epoch 75, CIFAR-10 Batch 4: Loss: 1.3751 Validation Accuracy: 0.477000 Epoch 75, CIFAR-10 Batch 5: Loss: 1.3882 Validation Accuracy: 0.478800 Epoch 76, CIFAR-10 Batch 1: Loss: 1.4812 Validation Accuracy: 0.404400 Epoch 76, CIFAR-10 Batch 2: Loss: 1.4752 Validation Accuracy: 0.510000 Epoch 76, CIFAR-10 Batch 3: Loss: 1.2566 Validation Accuracy: 0.444600 Epoch 76, CIFAR-10 Batch 4: Loss: 1.3652 Validation Accuracy: 0.486800 Epoch 76, CIFAR-10 Batch 5: Loss: 1.3257 Validation Accuracy: 0.478000 Epoch 77, CIFAR-10 Batch 1: Loss: 1.5122 Validation Accuracy: 0.488200 Epoch 77, CIFAR-10 Batch 2: Loss: 1.3813 Validation Accuracy: 0.485000 Epoch 77, CIFAR-10 Batch 3: Loss: 1.2648 Validation Accuracy: 0.456000 Epoch 77, CIFAR-10 Batch 4: Loss: 1.3693 Validation Accuracy: 0.240800 Epoch 77, CIFAR-10 Batch 5: Loss: 1.4038 Validation Accuracy: 0.508200 Epoch 78, CIFAR-10 Batch 1: Loss: 1.4717 Validation Accuracy: 0.452000 Epoch 78, CIFAR-10 Batch 2: Loss: 1.3167 Validation Accuracy: 0.480400 Epoch 78, CIFAR-10 Batch 3: Loss: 1.2248 Validation Accuracy: 0.453400 Epoch 78, CIFAR-10 Batch 4: Loss: 1.4152 Validation Accuracy: 0.403600 Epoch 78, CIFAR-10 Batch 5: Loss: 1.4524 Validation Accuracy: 0.491400 Epoch 79, CIFAR-10 Batch 1: Loss: 1.4640 Validation Accuracy: 0.433800 Epoch 79, CIFAR-10 Batch 2: Loss: 1.4949 Validation Accuracy: 0.428800 Epoch 79, CIFAR-10 Batch 3: Loss: 1.2469 Validation Accuracy: 0.512800 Epoch 79, CIFAR-10 Batch 4: Loss: 1.3244 Validation Accuracy: 0.508800 Epoch 79, CIFAR-10 Batch 5: Loss: 1.2991 Validation Accuracy: 0.494800 Epoch 80, CIFAR-10 Batch 1: Loss: 1.4677 Validation Accuracy: 0.349200 Epoch 80, CIFAR-10 Batch 2: Loss: 1.4686 Validation Accuracy: 0.479400 Epoch 80, CIFAR-10 Batch 3: Loss: 1.2393 Validation Accuracy: 0.492600 Epoch 80, CIFAR-10 Batch 4: Loss: 1.4305 Validation Accuracy: 0.492600 Epoch 80, CIFAR-10 Batch 5: Loss: 1.3731 Validation Accuracy: 0.463400 Epoch 81, CIFAR-10 Batch 1: Loss: 1.5038 Validation Accuracy: 0.442800 Epoch 81, CIFAR-10 Batch 2: Loss: 1.3811 Validation Accuracy: 0.495600 Epoch 81, CIFAR-10 Batch 3: Loss: 1.2481 Validation Accuracy: 0.474600 Epoch 81, CIFAR-10 Batch 4: Loss: 1.4519 Validation Accuracy: 0.499400 Epoch 81, CIFAR-10 Batch 5: Loss: 1.4362 Validation Accuracy: 0.486600 Epoch 82, CIFAR-10 Batch 1: Loss: 1.4729 Validation Accuracy: 0.553600 Epoch 82, CIFAR-10 Batch 2: Loss: 1.2994 Validation Accuracy: 0.551800 Epoch 82, CIFAR-10 Batch 3: Loss: 1.1766 Validation Accuracy: 0.552000 Epoch 82, CIFAR-10 Batch 4: Loss: 1.2923 Validation Accuracy: 0.549400 Epoch 82, CIFAR-10 Batch 5: Loss: 1.3005 Validation Accuracy: 0.550400 Epoch 83, CIFAR-10 Batch 1: Loss: 1.4261 Validation Accuracy: 0.561600 Epoch 83, CIFAR-10 Batch 2: Loss: 1.2326 Validation Accuracy: 0.561000 Epoch 83, CIFAR-10 Batch 3: Loss: 1.1716 Validation Accuracy: 0.560600 Epoch 83, CIFAR-10 Batch 4: Loss: 1.2702 Validation Accuracy: 0.561800 Epoch 83, CIFAR-10 Batch 5: Loss: 1.2768 Validation Accuracy: 0.560000 Epoch 84, CIFAR-10 Batch 1: Loss: 1.4052 Validation Accuracy: 0.562400 Epoch 84, CIFAR-10 Batch 2: Loss: 1.2276 Validation Accuracy: 0.562200 Epoch 84, CIFAR-10 Batch 3: Loss: 1.1625 Validation Accuracy: 0.560800 Epoch 84, CIFAR-10 Batch 4: Loss: 1.2652 Validation Accuracy: 0.561800 Epoch 84, CIFAR-10 Batch 5: Loss: 1.2756 Validation Accuracy: 0.562000 Epoch 85, CIFAR-10 Batch 1: Loss: 1.4051 Validation Accuracy: 0.562400 Epoch 85, CIFAR-10 Batch 2: Loss: 1.2276 Validation Accuracy: 0.562200 Epoch 85, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 85, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 85, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 86, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 86, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 86, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 86, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 86, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 87, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 87, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 87, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 87, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 87, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 88, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 88, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 88, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 88, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 88, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 89, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 89, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 89, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 89, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 89, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 90, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 90, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 90, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 90, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 90, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 91, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 91, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 91, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 91, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 91, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 92, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 92, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 92, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 92, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 92, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 93, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 93, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 93, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 93, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 93, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562400 Epoch 94, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 94, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 94, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 94, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 94, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 95, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 95, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 95, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 95, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 95, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 96, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 96, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 96, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 96, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561000 Epoch 96, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 97, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 97, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 97, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 97, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 97, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 98, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 98, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 98, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 98, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 98, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 99, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.563000 Epoch 99, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.563000 Epoch 99, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 99, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 99, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562600 Epoch 100, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 100, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 100, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560200 Epoch 100, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 100, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 101, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 101, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 101, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 101, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 101, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 102, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 102, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 102, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561400 Epoch 102, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 102, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 103, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 103, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 103, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561400 Epoch 103, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 103, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 104, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 104, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 104, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 104, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 104, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 105, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 105, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 105, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 105, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 105, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 106, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 106, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 106, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 106, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 106, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 107, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 107, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 107, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 107, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 107, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 108, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 108, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 108, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 108, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 108, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 109, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 109, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 109, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 109, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 109, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 110, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 110, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 110, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 110, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 110, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 111, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 111, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 111, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 111, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 111, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 112, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 112, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 112, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 112, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 112, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 113, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 113, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 113, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 113, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 113, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 114, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 114, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 114, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 114, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 114, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 115, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 115, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 115, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 115, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 115, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 116, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 116, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 116, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 116, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 116, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 117, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 117, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 117, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 117, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561200 Epoch 117, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 118, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 118, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 118, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 118, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 118, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 119, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 119, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 119, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561600 Epoch 119, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 119, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 120, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 120, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 120, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 120, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561000 Epoch 120, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562400 Epoch 121, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 121, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 121, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 121, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 121, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 122, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 122, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 122, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 122, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 122, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 123, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 123, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 123, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 123, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 123, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 124, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 124, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 124, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 124, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 124, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 125, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 125, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 125, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 125, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 125, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 126, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 126, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 126, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 126, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561200 Epoch 126, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 127, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 127, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 127, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560200 Epoch 127, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 127, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 128, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 128, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 128, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 128, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 128, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 129, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 129, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 129, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 129, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 129, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 130, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.563000 Epoch 130, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 130, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 130, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 130, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 131, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 131, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 131, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 131, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 131, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562800 Epoch 132, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 132, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 132, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 132, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 132, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 133, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 133, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 133, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 133, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 133, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 134, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 134, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 134, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 134, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 134, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 135, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 135, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 135, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 135, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561200 Epoch 135, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 136, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 136, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 136, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560200 Epoch 136, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 136, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 137, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 137, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 137, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 137, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 137, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 138, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 138, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 138, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 138, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 138, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 139, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 139, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 139, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 139, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 139, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 140, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 140, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 140, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 140, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 140, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 141, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 141, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 141, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 141, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 141, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 142, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 142, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 142, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 142, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 142, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 143, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 143, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 143, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 143, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 143, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 144, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 144, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 144, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 144, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 144, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 145, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 145, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 145, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 145, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 145, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562400 Epoch 146, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 146, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 146, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 146, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 146, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 147, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 147, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 147, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 147, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561600 Epoch 147, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561400 Epoch 148, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 148, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 148, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 148, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 148, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 149, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 149, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 149, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 149, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 149, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 150, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 150, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 150, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561200 Epoch 150, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562600 Epoch 150, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561800 Epoch 151, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 151, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 151, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 151, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 151, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 152, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 152, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 152, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 152, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 152, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 153, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 153, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562800 Epoch 153, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 153, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 153, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 154, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 154, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 154, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 154, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 154, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562400 Epoch 155, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 155, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 155, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 155, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 155, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 156, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 156, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 156, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 156, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562400 Epoch 156, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562400 Epoch 157, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 157, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 157, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 157, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 157, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 158, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 158, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562000 Epoch 158, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.561000 Epoch 158, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 158, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 159, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562600 Epoch 159, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562400 Epoch 159, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 159, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 159, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 160, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 160, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562200 Epoch 160, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 160, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 160, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 161, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562400 Epoch 161, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 161, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560800 Epoch 161, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561800 Epoch 161, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Epoch 162, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562200 Epoch 162, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 162, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 162, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562000 Epoch 162, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562200 Epoch 163, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 163, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 163, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560600 Epoch 163, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.561400 Epoch 163, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.561600 Epoch 164, CIFAR-10 Batch 1: Loss: 1.4050 Validation Accuracy: 0.562800 Epoch 164, CIFAR-10 Batch 2: Loss: 1.2275 Validation Accuracy: 0.562600 Epoch 164, CIFAR-10 Batch 3: Loss: 1.1624 Validation Accuracy: 0.560400 Epoch 164, CIFAR-10 Batch 4: Loss: 1.2650 Validation Accuracy: 0.562200 Epoch 164, CIFAR-10 Batch 5: Loss: 1.2754 Validation Accuracy: 0.562000 Training for learning_rate=0.01000, batch_size=64 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.5863 Validation Accuracy: 0.138200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6469 Validation Accuracy: 0.231800 Epoch 1, CIFAR-10 Batch 3: Loss: 1.3867 Validation Accuracy: 0.410000 Epoch 1, CIFAR-10 Batch 4: Loss: 1.3407 Validation Accuracy: 0.268400 Epoch 1, CIFAR-10 Batch 5: Loss: 1.3281 Validation Accuracy: 0.457200 Epoch 2, CIFAR-10 Batch 1: Loss: 1.0281 Validation Accuracy: 0.436200 Epoch 2, CIFAR-10 Batch 2: Loss: 1.3190 Validation Accuracy: 0.557400 Epoch 2, CIFAR-10 Batch 3: Loss: 1.1946 Validation Accuracy: 0.400600 Epoch 2, CIFAR-10 Batch 4: Loss: 1.1134 Validation Accuracy: 0.484800 Epoch 2, CIFAR-10 Batch 5: Loss: 1.1293 Validation Accuracy: 0.553400 Epoch 3, CIFAR-10 Batch 1: Loss: 0.9180 Validation Accuracy: 0.399400 Epoch 3, CIFAR-10 Batch 2: Loss: 1.0990 Validation Accuracy: 0.630000 Epoch 3, CIFAR-10 Batch 3: Loss: 1.0595 Validation Accuracy: 0.557600 Epoch 3, CIFAR-10 Batch 4: Loss: 0.9900 Validation Accuracy: 0.541000 Epoch 3, CIFAR-10 Batch 5: Loss: 0.7181 Validation Accuracy: 0.527600 Epoch 4, CIFAR-10 Batch 1: Loss: 0.7450 Validation Accuracy: 0.579600 Epoch 4, CIFAR-10 Batch 2: Loss: 0.8290 Validation Accuracy: 0.641000 Epoch 4, CIFAR-10 Batch 3: Loss: 0.9286 Validation Accuracy: 0.645800 Epoch 4, CIFAR-10 Batch 4: Loss: 0.7973 Validation Accuracy: 0.537800 Epoch 4, CIFAR-10 Batch 5: Loss: 0.6693 Validation Accuracy: 0.681200 Epoch 5, CIFAR-10 Batch 1: Loss: 0.7476 Validation Accuracy: 0.554000 Epoch 5, CIFAR-10 Batch 2: Loss: 0.7348 Validation Accuracy: 0.655800 Epoch 5, CIFAR-10 Batch 3: Loss: 0.8829 Validation Accuracy: 0.541600 Epoch 5, CIFAR-10 Batch 4: Loss: 0.6773 Validation Accuracy: 0.724000 Epoch 5, CIFAR-10 Batch 5: Loss: 0.7242 Validation Accuracy: 0.592800 Epoch 6, CIFAR-10 Batch 1: Loss: 0.6707 Validation Accuracy: 0.623600 Epoch 6, CIFAR-10 Batch 2: Loss: 0.7080 Validation Accuracy: 0.734600 Epoch 6, CIFAR-10 Batch 3: Loss: 0.6888 Validation Accuracy: 0.665200 Epoch 6, CIFAR-10 Batch 4: Loss: 0.6477 Validation Accuracy: 0.701200 Epoch 6, CIFAR-10 Batch 5: Loss: 0.6296 Validation Accuracy: 0.652200 Epoch 7, CIFAR-10 Batch 1: Loss: 0.6163 Validation Accuracy: 0.676600 Epoch 7, CIFAR-10 Batch 2: Loss: 0.6105 Validation Accuracy: 0.718400 Epoch 7, CIFAR-10 Batch 3: Loss: 0.6815 Validation Accuracy: 0.571800 Epoch 7, CIFAR-10 Batch 4: Loss: 0.5698 Validation Accuracy: 0.734400 Epoch 7, CIFAR-10 Batch 5: Loss: 0.7592 Validation Accuracy: 0.603400 Epoch 8, CIFAR-10 Batch 1: Loss: 0.5661 Validation Accuracy: 0.533800 Epoch 8, CIFAR-10 Batch 2: Loss: 0.5877 Validation Accuracy: 0.557800 Epoch 8, CIFAR-10 Batch 3: Loss: 0.6045 Validation Accuracy: 0.731000 Epoch 8, CIFAR-10 Batch 4: Loss: 0.6332 Validation Accuracy: 0.769600 Epoch 8, CIFAR-10 Batch 5: Loss: 0.5758 Validation Accuracy: 0.612200 Epoch 9, CIFAR-10 Batch 1: Loss: 0.5311 Validation Accuracy: 0.649600 Epoch 9, CIFAR-10 Batch 2: Loss: 0.5614 Validation Accuracy: 0.690000 Epoch 9, CIFAR-10 Batch 3: Loss: 0.5194 Validation Accuracy: 0.680400 Epoch 9, CIFAR-10 Batch 4: Loss: 0.5577 Validation Accuracy: 0.690400 Epoch 9, CIFAR-10 Batch 5: Loss: 0.5103 Validation Accuracy: 0.686800 Epoch 10, CIFAR-10 Batch 1: Loss: 0.5023 Validation Accuracy: 0.719800 Epoch 10, CIFAR-10 Batch 2: Loss: 0.5638 Validation Accuracy: 0.639600 Epoch 10, CIFAR-10 Batch 3: Loss: 0.5657 Validation Accuracy: 0.706400 Epoch 10, CIFAR-10 Batch 4: Loss: 0.5381 Validation Accuracy: 0.711200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.5039 Validation Accuracy: 0.648800 Epoch 11, CIFAR-10 Batch 1: Loss: 0.4942 Validation Accuracy: 0.679000 Epoch 11, CIFAR-10 Batch 2: Loss: 0.5023 Validation Accuracy: 0.763800 Epoch 11, CIFAR-10 Batch 3: Loss: 0.5341 Validation Accuracy: 0.706400 Epoch 11, CIFAR-10 Batch 4: Loss: 0.5427 Validation Accuracy: 0.743000 Epoch 11, CIFAR-10 Batch 5: Loss: 0.4941 Validation Accuracy: 0.630200 Epoch 12, CIFAR-10 Batch 1: Loss: 0.5098 Validation Accuracy: 0.646400 Epoch 12, CIFAR-10 Batch 2: Loss: 0.5064 Validation Accuracy: 0.659200 Epoch 12, CIFAR-10 Batch 3: Loss: 0.4795 Validation Accuracy: 0.740000 Epoch 12, CIFAR-10 Batch 4: Loss: 0.4640 Validation Accuracy: 0.779800 Epoch 12, CIFAR-10 Batch 5: Loss: 0.5554 Validation Accuracy: 0.627400 Epoch 13, CIFAR-10 Batch 1: Loss: 0.4953 Validation Accuracy: 0.732800 Epoch 13, CIFAR-10 Batch 2: Loss: 0.5041 Validation Accuracy: 0.684600 Epoch 13, CIFAR-10 Batch 3: Loss: 0.4717 Validation Accuracy: 0.747600 Epoch 13, CIFAR-10 Batch 4: Loss: 0.4978 Validation Accuracy: 0.710200 Epoch 13, CIFAR-10 Batch 5: Loss: 0.5321 Validation Accuracy: 0.724000 Epoch 14, CIFAR-10 Batch 1: Loss: 0.5567 Validation Accuracy: 0.657200 Epoch 14, CIFAR-10 Batch 2: Loss: 0.4616 Validation Accuracy: 0.705200 Epoch 14, CIFAR-10 Batch 3: Loss: 0.4018 Validation Accuracy: 0.767800 Epoch 14, CIFAR-10 Batch 4: Loss: 0.4958 Validation Accuracy: 0.782400 Epoch 14, CIFAR-10 Batch 5: Loss: 0.3758 Validation Accuracy: 0.763400 Epoch 15, CIFAR-10 Batch 1: Loss: 0.4532 Validation Accuracy: 0.683800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.4124 Validation Accuracy: 0.696400 Epoch 15, CIFAR-10 Batch 3: Loss: 0.3832 Validation Accuracy: 0.725600 Epoch 15, CIFAR-10 Batch 4: Loss: 0.4057 Validation Accuracy: 0.548400 Epoch 15, CIFAR-10 Batch 5: Loss: 0.4294 Validation Accuracy: 0.651200 Epoch 16, CIFAR-10 Batch 1: Loss: 0.4423 Validation Accuracy: 0.752400 Epoch 16, CIFAR-10 Batch 2: Loss: 0.3700 Validation Accuracy: 0.790000 Epoch 16, CIFAR-10 Batch 3: Loss: 0.3786 Validation Accuracy: 0.762000 Epoch 16, CIFAR-10 Batch 4: Loss: 0.4496 Validation Accuracy: 0.732200 Epoch 16, CIFAR-10 Batch 5: Loss: 0.3443 Validation Accuracy: 0.654200 Epoch 17, CIFAR-10 Batch 1: Loss: 0.4225 Validation Accuracy: 0.759000 Epoch 17, CIFAR-10 Batch 2: Loss: 0.4447 Validation Accuracy: 0.784200 Epoch 17, CIFAR-10 Batch 3: Loss: 0.3580 Validation Accuracy: 0.790600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.4736 Validation Accuracy: 0.783200 Epoch 17, CIFAR-10 Batch 5: Loss: 0.3555 Validation Accuracy: 0.721600 Epoch 18, CIFAR-10 Batch 1: Loss: 0.3605 Validation Accuracy: 0.747200 Epoch 18, CIFAR-10 Batch 2: Loss: 0.4143 Validation Accuracy: 0.712800 Epoch 18, CIFAR-10 Batch 3: Loss: 0.4262 Validation Accuracy: 0.717600 Epoch 18, CIFAR-10 Batch 4: Loss: 0.4574 Validation Accuracy: 0.781600 Epoch 18, CIFAR-10 Batch 5: Loss: 0.3900 Validation Accuracy: 0.748200 Epoch 19, CIFAR-10 Batch 1: Loss: 0.3719 Validation Accuracy: 0.724600 Epoch 19, CIFAR-10 Batch 2: Loss: 0.3860 Validation Accuracy: 0.745800 Epoch 19, CIFAR-10 Batch 3: Loss: 0.4078 Validation Accuracy: 0.736000 Epoch 19, CIFAR-10 Batch 4: Loss: 0.3427 Validation Accuracy: 0.731000 Epoch 19, CIFAR-10 Batch 5: Loss: 0.3882 Validation Accuracy: 0.717800 Epoch 20, CIFAR-10 Batch 1: Loss: 0.3883 Validation Accuracy: 0.729800 Epoch 20, CIFAR-10 Batch 2: Loss: 0.3591 Validation Accuracy: 0.810200 Epoch 20, CIFAR-10 Batch 3: Loss: 0.3322 Validation Accuracy: 0.755400 Epoch 20, CIFAR-10 Batch 4: Loss: 0.4715 Validation Accuracy: 0.811800 Epoch 20, CIFAR-10 Batch 5: Loss: 0.3540 Validation Accuracy: 0.763600 Epoch 21, CIFAR-10 Batch 1: Loss: 0.3747 Validation Accuracy: 0.794800 Epoch 21, CIFAR-10 Batch 2: Loss: 0.3745 Validation Accuracy: 0.791200 Epoch 21, CIFAR-10 Batch 3: Loss: 0.3666 Validation Accuracy: 0.713000 Epoch 21, CIFAR-10 Batch 4: Loss: 0.3881 Validation Accuracy: 0.671200 Epoch 21, CIFAR-10 Batch 5: Loss: 0.3580 Validation Accuracy: 0.746400 Epoch 22, CIFAR-10 Batch 1: Loss: 0.3445 Validation Accuracy: 0.739800 Epoch 22, CIFAR-10 Batch 2: Loss: 0.3197 Validation Accuracy: 0.795400 Epoch 22, CIFAR-10 Batch 3: Loss: 0.3879 Validation Accuracy: 0.784400 Epoch 22, CIFAR-10 Batch 4: Loss: 0.3565 Validation Accuracy: 0.784000 Epoch 22, CIFAR-10 Batch 5: Loss: 0.3141 Validation Accuracy: 0.744800 Epoch 23, CIFAR-10 Batch 1: Loss: 0.3450 Validation Accuracy: 0.750200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.2961 Validation Accuracy: 0.780000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.3554 Validation Accuracy: 0.752000 Epoch 23, CIFAR-10 Batch 4: Loss: 0.3586 Validation Accuracy: 0.775800 Epoch 23, CIFAR-10 Batch 5: Loss: 0.3186 Validation Accuracy: 0.702800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.3868 Validation Accuracy: 0.770200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.3039 Validation Accuracy: 0.797000 Epoch 24, CIFAR-10 Batch 3: Loss: 0.2905 Validation Accuracy: 0.788600 Epoch 24, CIFAR-10 Batch 4: Loss: 0.4458 Validation Accuracy: 0.708000 Epoch 24, CIFAR-10 Batch 5: Loss: 0.3413 Validation Accuracy: 0.741000 Epoch 25, CIFAR-10 Batch 1: Loss: 0.3746 Validation Accuracy: 0.748200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.3366 Validation Accuracy: 0.766200 Epoch 25, CIFAR-10 Batch 3: Loss: 0.3137 Validation Accuracy: 0.774600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.3380 Validation Accuracy: 0.704800 Epoch 25, CIFAR-10 Batch 5: Loss: 0.3400 Validation Accuracy: 0.762200 Epoch 26, CIFAR-10 Batch 1: Loss: 0.3604 Validation Accuracy: 0.732400 Epoch 26, CIFAR-10 Batch 2: Loss: 0.2834 Validation Accuracy: 0.802400 Epoch 26, CIFAR-10 Batch 3: Loss: 0.3297 Validation Accuracy: 0.746600 Epoch 26, CIFAR-10 Batch 4: Loss: 0.3918 Validation Accuracy: 0.739200 Epoch 26, CIFAR-10 Batch 5: Loss: 0.2905 Validation Accuracy: 0.749800 Epoch 27, CIFAR-10 Batch 1: Loss: 0.3456 Validation Accuracy: 0.814400 Epoch 27, CIFAR-10 Batch 2: Loss: 0.3211 Validation Accuracy: 0.794600 Epoch 27, CIFAR-10 Batch 3: Loss: 0.3184 Validation Accuracy: 0.753800 Epoch 27, CIFAR-10 Batch 4: Loss: 0.3661 Validation Accuracy: 0.814600 Epoch 27, CIFAR-10 Batch 5: Loss: 0.2666 Validation Accuracy: 0.768600 Epoch 28, CIFAR-10 Batch 1: Loss: 0.3082 Validation Accuracy: 0.777000 Epoch 28, CIFAR-10 Batch 2: Loss: 0.3088 Validation Accuracy: 0.800200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.2886 Validation Accuracy: 0.817400 Epoch 28, CIFAR-10 Batch 4: Loss: 0.2977 Validation Accuracy: 0.831600 Epoch 28, CIFAR-10 Batch 5: Loss: 0.3147 Validation Accuracy: 0.759800 Epoch 29, CIFAR-10 Batch 1: Loss: 0.2678 Validation Accuracy: 0.803000 Epoch 29, CIFAR-10 Batch 2: Loss: 0.3319 Validation Accuracy: 0.766200 Epoch 29, CIFAR-10 Batch 3: Loss: 0.3400 Validation Accuracy: 0.754400 Epoch 29, CIFAR-10 Batch 4: Loss: 0.3101 Validation Accuracy: 0.784400 Epoch 29, CIFAR-10 Batch 5: Loss: 0.2673 Validation Accuracy: 0.789000 Epoch 30, CIFAR-10 Batch 1: Loss: 0.3241 Validation Accuracy: 0.791200 Epoch 30, CIFAR-10 Batch 2: Loss: 0.3084 Validation Accuracy: 0.786400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.2763 Validation Accuracy: 0.806400 Epoch 30, CIFAR-10 Batch 4: Loss: 0.3441 Validation Accuracy: 0.770600 Epoch 30, CIFAR-10 Batch 5: Loss: 0.3304 Validation Accuracy: 0.777600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.3226 Validation Accuracy: 0.802600 Epoch 31, CIFAR-10 Batch 2: Loss: 0.3247 Validation Accuracy: 0.813600 Epoch 31, CIFAR-10 Batch 3: Loss: 0.2383 Validation Accuracy: 0.820800 Epoch 31, CIFAR-10 Batch 4: Loss: 0.3117 Validation Accuracy: 0.827000 Epoch 31, CIFAR-10 Batch 5: Loss: 0.2879 Validation Accuracy: 0.793200 Epoch 32, CIFAR-10 Batch 1: Loss: 0.3239 Validation Accuracy: 0.814600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.3394 Validation Accuracy: 0.686600 Epoch 32, CIFAR-10 Batch 3: Loss: 0.2734 Validation Accuracy: 0.810000 Epoch 32, CIFAR-10 Batch 4: Loss: 0.3109 Validation Accuracy: 0.794600 Epoch 32, CIFAR-10 Batch 5: Loss: 0.2709 Validation Accuracy: 0.807800 Epoch 33, CIFAR-10 Batch 1: Loss: 0.3226 Validation Accuracy: 0.807600 Epoch 33, CIFAR-10 Batch 2: Loss: 0.3253 Validation Accuracy: 0.783200 Epoch 33, CIFAR-10 Batch 3: Loss: 0.2919 Validation Accuracy: 0.780200 Epoch 33, CIFAR-10 Batch 4: Loss: 0.2984 Validation Accuracy: 0.749800 Epoch 33, CIFAR-10 Batch 5: Loss: 0.2545 Validation Accuracy: 0.775200 Epoch 34, CIFAR-10 Batch 1: Loss: 0.2792 Validation Accuracy: 0.785200 Epoch 34, CIFAR-10 Batch 2: Loss: 0.2911 Validation Accuracy: 0.790600 Epoch 34, CIFAR-10 Batch 3: Loss: 0.2809 Validation Accuracy: 0.741800 Epoch 34, CIFAR-10 Batch 4: Loss: 0.2428 Validation Accuracy: 0.801600 Epoch 34, CIFAR-10 Batch 5: Loss: 0.3058 Validation Accuracy: 0.751800 Epoch 35, CIFAR-10 Batch 1: Loss: 0.3264 Validation Accuracy: 0.838800 Epoch 35, CIFAR-10 Batch 2: Loss: 0.3609 Validation Accuracy: 0.825400 Epoch 35, CIFAR-10 Batch 3: Loss: 0.2595 Validation Accuracy: 0.737600 Epoch 35, CIFAR-10 Batch 4: Loss: 0.2886 Validation Accuracy: 0.774000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.3291 Validation Accuracy: 0.798200 Epoch 36, CIFAR-10 Batch 1: Loss: 0.3065 Validation Accuracy: 0.741000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.2721 Validation Accuracy: 0.779400 Epoch 36, CIFAR-10 Batch 3: Loss: 0.2335 Validation Accuracy: 0.775600 Epoch 36, CIFAR-10 Batch 4: Loss: 0.3469 Validation Accuracy: 0.754600 Epoch 36, CIFAR-10 Batch 5: Loss: 0.2716 Validation Accuracy: 0.794200 Epoch 37, CIFAR-10 Batch 1: Loss: 0.2819 Validation Accuracy: 0.787800 Epoch 37, CIFAR-10 Batch 2: Loss: 0.2921 Validation Accuracy: 0.808600 Epoch 37, CIFAR-10 Batch 3: Loss: 0.2726 Validation Accuracy: 0.792400 Epoch 37, CIFAR-10 Batch 4: Loss: 0.2553 Validation Accuracy: 0.809200 Epoch 37, CIFAR-10 Batch 5: Loss: 0.2475 Validation Accuracy: 0.807200 Epoch 38, CIFAR-10 Batch 1: Loss: 0.2835 Validation Accuracy: 0.781000 Epoch 38, CIFAR-10 Batch 2: Loss: 0.2860 Validation Accuracy: 0.804000 Epoch 38, CIFAR-10 Batch 3: Loss: 0.2250 Validation Accuracy: 0.808400 Epoch 38, CIFAR-10 Batch 4: Loss: 0.2838 Validation Accuracy: 0.784000 Epoch 38, CIFAR-10 Batch 5: Loss: 0.2421 Validation Accuracy: 0.831800 Epoch 39, CIFAR-10 Batch 1: Loss: 0.2735 Validation Accuracy: 0.828200 Epoch 39, CIFAR-10 Batch 2: Loss: 0.2707 Validation Accuracy: 0.818800 Epoch 39, CIFAR-10 Batch 3: Loss: 0.2827 Validation Accuracy: 0.800400 Epoch 39, CIFAR-10 Batch 4: Loss: 0.3134 Validation Accuracy: 0.818000 Epoch 39, CIFAR-10 Batch 5: Loss: 0.2673 Validation Accuracy: 0.803200 Epoch 40, CIFAR-10 Batch 1: Loss: 0.2571 Validation Accuracy: 0.795400 Epoch 40, CIFAR-10 Batch 2: Loss: 0.2745 Validation Accuracy: 0.820000 Epoch 40, CIFAR-10 Batch 3: Loss: 0.2245 Validation Accuracy: 0.774200 Epoch 40, CIFAR-10 Batch 4: Loss: 0.2580 Validation Accuracy: 0.804000 Epoch 40, CIFAR-10 Batch 5: Loss: 0.2767 Validation Accuracy: 0.806400 Epoch 41, CIFAR-10 Batch 1: Loss: 0.2670 Validation Accuracy: 0.750600 Epoch 41, CIFAR-10 Batch 2: Loss: 0.2750 Validation Accuracy: 0.801400 Epoch 41, CIFAR-10 Batch 3: Loss: 0.2327 Validation Accuracy: 0.781400 Epoch 41, CIFAR-10 Batch 4: Loss: 0.2535 Validation Accuracy: 0.804200 Epoch 41, CIFAR-10 Batch 5: Loss: 0.2046 Validation Accuracy: 0.801400 Epoch 42, CIFAR-10 Batch 1: Loss: 0.2556 Validation Accuracy: 0.816600 Epoch 42, CIFAR-10 Batch 2: Loss: 0.2440 Validation Accuracy: 0.822200 Epoch 42, CIFAR-10 Batch 3: Loss: 0.2217 Validation Accuracy: 0.826600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.2502 Validation Accuracy: 0.822800 Epoch 42, CIFAR-10 Batch 5: Loss: 0.2398 Validation Accuracy: 0.803000 Epoch 43, CIFAR-10 Batch 1: Loss: 0.2687 Validation Accuracy: 0.811600 Epoch 43, CIFAR-10 Batch 2: Loss: 0.2558 Validation Accuracy: 0.817000 Epoch 43, CIFAR-10 Batch 3: Loss: 0.2457 Validation Accuracy: 0.794800 Epoch 43, CIFAR-10 Batch 4: Loss: 0.2835 Validation Accuracy: 0.800800 Epoch 43, CIFAR-10 Batch 5: Loss: 0.2651 Validation Accuracy: 0.785000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.2503 Validation Accuracy: 0.825800 Epoch 44, CIFAR-10 Batch 2: Loss: 0.2644 Validation Accuracy: 0.803200 Epoch 44, CIFAR-10 Batch 3: Loss: 0.2122 Validation Accuracy: 0.714000 Epoch 44, CIFAR-10 Batch 4: Loss: 0.2564 Validation Accuracy: 0.804200 Epoch 44, CIFAR-10 Batch 5: Loss: 0.2333 Validation Accuracy: 0.810800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.2555 Validation Accuracy: 0.795000 Epoch 45, CIFAR-10 Batch 2: Loss: 0.2363 Validation Accuracy: 0.820000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.2134 Validation Accuracy: 0.787200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.2867 Validation Accuracy: 0.821600 Epoch 45, CIFAR-10 Batch 5: Loss: 0.2394 Validation Accuracy: 0.761800 Epoch 46, CIFAR-10 Batch 1: Loss: 0.2812 Validation Accuracy: 0.840200 Epoch 46, CIFAR-10 Batch 2: Loss: 0.2899 Validation Accuracy: 0.716600 Epoch 46, CIFAR-10 Batch 3: Loss: 0.2075 Validation Accuracy: 0.808600 Epoch 46, CIFAR-10 Batch 4: Loss: 0.2546 Validation Accuracy: 0.831000 Epoch 46, CIFAR-10 Batch 5: Loss: 0.2669 Validation Accuracy: 0.797000 Epoch 47, CIFAR-10 Batch 1: Loss: 0.2202 Validation Accuracy: 0.821000 Epoch 47, CIFAR-10 Batch 2: Loss: 0.2771 Validation Accuracy: 0.810200 Epoch 47, CIFAR-10 Batch 3: Loss: 0.2748 Validation Accuracy: 0.818400 Epoch 47, CIFAR-10 Batch 4: Loss: 0.2090 Validation Accuracy: 0.663400 Epoch 47, CIFAR-10 Batch 5: Loss: 0.2196 Validation Accuracy: 0.786200 Epoch 48, CIFAR-10 Batch 1: Loss: 0.2300 Validation Accuracy: 0.811400 Epoch 48, CIFAR-10 Batch 2: Loss: 0.2978 Validation Accuracy: 0.807000 Epoch 48, CIFAR-10 Batch 3: Loss: 0.2140 Validation Accuracy: 0.823200 Epoch 48, CIFAR-10 Batch 4: Loss: 0.2427 Validation Accuracy: 0.782800 Epoch 48, CIFAR-10 Batch 5: Loss: 0.2794 Validation Accuracy: 0.785800 Epoch 49, CIFAR-10 Batch 1: Loss: 0.2369 Validation Accuracy: 0.833600 Epoch 49, CIFAR-10 Batch 2: Loss: 0.2787 Validation Accuracy: 0.827600 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1946 Validation Accuracy: 0.824200 Epoch 49, CIFAR-10 Batch 4: Loss: 0.3339 Validation Accuracy: 0.770000 Epoch 49, CIFAR-10 Batch 5: Loss: 0.2782 Validation Accuracy: 0.778800 Epoch 50, CIFAR-10 Batch 1: Loss: 0.2004 Validation Accuracy: 0.815600 Epoch 50, CIFAR-10 Batch 2: Loss: 0.2941 Validation Accuracy: 0.779000 Epoch 50, CIFAR-10 Batch 3: Loss: 0.2501 Validation Accuracy: 0.742400 Epoch 50, CIFAR-10 Batch 4: Loss: 0.2557 Validation Accuracy: 0.781800 Epoch 50, CIFAR-10 Batch 5: Loss: 0.2263 Validation Accuracy: 0.813200 Epoch 51, CIFAR-10 Batch 1: Loss: 0.2561 Validation Accuracy: 0.831600 Epoch 51, CIFAR-10 Batch 2: Loss: 0.2625 Validation Accuracy: 0.773800 Epoch 51, CIFAR-10 Batch 3: Loss: 0.2157 Validation Accuracy: 0.822000 Epoch 51, CIFAR-10 Batch 4: Loss: 0.2129 Validation Accuracy: 0.837000 Epoch 51, CIFAR-10 Batch 5: Loss: 0.2331 Validation Accuracy: 0.822400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.2002 Validation Accuracy: 0.778200 Epoch 52, CIFAR-10 Batch 2: Loss: 0.2401 Validation Accuracy: 0.788200 Epoch 52, CIFAR-10 Batch 3: Loss: 0.2386 Validation Accuracy: 0.801000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.2251 Validation Accuracy: 0.837200 Epoch 52, CIFAR-10 Batch 5: Loss: 0.2356 Validation Accuracy: 0.806000 Epoch 53, CIFAR-10 Batch 1: Loss: 0.2070 Validation Accuracy: 0.767800 Epoch 53, CIFAR-10 Batch 2: Loss: 0.2249 Validation Accuracy: 0.786200 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1987 Validation Accuracy: 0.805800 Epoch 53, CIFAR-10 Batch 4: Loss: 0.2210 Validation Accuracy: 0.833600 Epoch 53, CIFAR-10 Batch 5: Loss: 0.2358 Validation Accuracy: 0.828200 Epoch 54, CIFAR-10 Batch 1: Loss: 0.2245 Validation Accuracy: 0.795800 Epoch 54, CIFAR-10 Batch 2: Loss: 0.3128 Validation Accuracy: 0.829200 Epoch 54, CIFAR-10 Batch 3: Loss: 0.2166 Validation Accuracy: 0.803800 Epoch 54, CIFAR-10 Batch 4: Loss: 0.2374 Validation Accuracy: 0.791800 Epoch 54, CIFAR-10 Batch 5: Loss: 0.2606 Validation Accuracy: 0.822000 Epoch 55, CIFAR-10 Batch 1: Loss: 0.2171 Validation Accuracy: 0.824000 Epoch 55, CIFAR-10 Batch 2: Loss: 0.2784 Validation Accuracy: 0.806000 Epoch 55, CIFAR-10 Batch 3: Loss: 0.2224 Validation Accuracy: 0.800200 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1994 Validation Accuracy: 0.805000 Epoch 55, CIFAR-10 Batch 5: Loss: 0.2312 Validation Accuracy: 0.804200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.2073 Validation Accuracy: 0.823200 Epoch 56, CIFAR-10 Batch 2: Loss: 0.2223 Validation Accuracy: 0.817800 Epoch 56, CIFAR-10 Batch 3: Loss: 0.1988 Validation Accuracy: 0.831600 Epoch 56, CIFAR-10 Batch 4: Loss: 0.2065 Validation Accuracy: 0.782000 Epoch 56, CIFAR-10 Batch 5: Loss: 0.2463 Validation Accuracy: 0.738600 Epoch 57, CIFAR-10 Batch 1: Loss: 0.2228 Validation Accuracy: 0.821400 Epoch 57, CIFAR-10 Batch 2: Loss: 0.2631 Validation Accuracy: 0.828600 Epoch 57, CIFAR-10 Batch 3: Loss: 0.1964 Validation Accuracy: 0.820800 Epoch 57, CIFAR-10 Batch 4: Loss: 0.2202 Validation Accuracy: 0.835000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.1944 Validation Accuracy: 0.836800 Epoch 58, CIFAR-10 Batch 1: Loss: 0.2144 Validation Accuracy: 0.810000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.2287 Validation Accuracy: 0.784000 Epoch 58, CIFAR-10 Batch 3: Loss: 0.2239 Validation Accuracy: 0.793000 Epoch 58, CIFAR-10 Batch 4: Loss: 0.2037 Validation Accuracy: 0.804400 Epoch 58, CIFAR-10 Batch 5: Loss: 0.1917 Validation Accuracy: 0.825800 Epoch 59, CIFAR-10 Batch 1: Loss: 0.2391 Validation Accuracy: 0.783000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.2802 Validation Accuracy: 0.757800 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1985 Validation Accuracy: 0.781800 Epoch 59, CIFAR-10 Batch 4: Loss: 0.2331 Validation Accuracy: 0.832200 Epoch 59, CIFAR-10 Batch 5: Loss: 0.2172 Validation Accuracy: 0.774400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.1932 Validation Accuracy: 0.811800 Epoch 60, CIFAR-10 Batch 2: Loss: 0.2572 Validation Accuracy: 0.818600 Epoch 60, CIFAR-10 Batch 3: Loss: 0.2095 Validation Accuracy: 0.820600 Epoch 60, CIFAR-10 Batch 4: Loss: 0.2074 Validation Accuracy: 0.812600 Epoch 60, CIFAR-10 Batch 5: Loss: 0.1979 Validation Accuracy: 0.771000 Epoch 61, CIFAR-10 Batch 1: Loss: 0.2044 Validation Accuracy: 0.822400 Epoch 61, CIFAR-10 Batch 2: Loss: 0.2669 Validation Accuracy: 0.820400 Epoch 61, CIFAR-10 Batch 3: Loss: 0.2146 Validation Accuracy: 0.789600 Epoch 61, CIFAR-10 Batch 4: Loss: 0.2317 Validation Accuracy: 0.845600 Epoch 61, CIFAR-10 Batch 5: Loss: 0.2136 Validation Accuracy: 0.816600 Epoch 62, CIFAR-10 Batch 1: Loss: 0.1927 Validation Accuracy: 0.840000 Epoch 62, CIFAR-10 Batch 2: Loss: 0.2544 Validation Accuracy: 0.763600 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1922 Validation Accuracy: 0.836800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.2324 Validation Accuracy: 0.780000 Epoch 62, CIFAR-10 Batch 5: Loss: 0.2184 Validation Accuracy: 0.787600 Epoch 63, CIFAR-10 Batch 1: Loss: 0.2123 Validation Accuracy: 0.840600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.2543 Validation Accuracy: 0.802800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.1992 Validation Accuracy: 0.788800 Epoch 63, CIFAR-10 Batch 4: Loss: 0.2090 Validation Accuracy: 0.818600 Epoch 63, CIFAR-10 Batch 5: Loss: 0.1823 Validation Accuracy: 0.829800 Epoch 64, CIFAR-10 Batch 1: Loss: 0.2447 Validation Accuracy: 0.834400 Epoch 64, CIFAR-10 Batch 2: Loss: 0.2694 Validation Accuracy: 0.797200 Epoch 64, CIFAR-10 Batch 3: Loss: 0.2252 Validation Accuracy: 0.823600 Epoch 64, CIFAR-10 Batch 4: Loss: 0.2131 Validation Accuracy: 0.745800 Epoch 64, CIFAR-10 Batch 5: Loss: 0.2167 Validation Accuracy: 0.810400 Epoch 65, CIFAR-10 Batch 1: Loss: 0.2067 Validation Accuracy: 0.793200 Epoch 65, CIFAR-10 Batch 2: Loss: 0.2287 Validation Accuracy: 0.821800 Epoch 65, CIFAR-10 Batch 3: Loss: 0.2170 Validation Accuracy: 0.821400 Epoch 65, CIFAR-10 Batch 4: Loss: 0.2214 Validation Accuracy: 0.823200 Epoch 65, CIFAR-10 Batch 5: Loss: 0.2211 Validation Accuracy: 0.787800 Epoch 66, CIFAR-10 Batch 1: Loss: 0.2266 Validation Accuracy: 0.824000 Epoch 66, CIFAR-10 Batch 2: Loss: 0.2750 Validation Accuracy: 0.772600 Epoch 66, CIFAR-10 Batch 3: Loss: 0.2216 Validation Accuracy: 0.810400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.2069 Validation Accuracy: 0.833800 Epoch 66, CIFAR-10 Batch 5: Loss: 0.1927 Validation Accuracy: 0.826000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.2055 Validation Accuracy: 0.826600 Epoch 67, CIFAR-10 Batch 2: Loss: 0.2448 Validation Accuracy: 0.832000 Epoch 67, CIFAR-10 Batch 3: Loss: 0.2275 Validation Accuracy: 0.804800 Epoch 67, CIFAR-10 Batch 4: Loss: 0.2233 Validation Accuracy: 0.805200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.1814 Validation Accuracy: 0.823000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.2010 Validation Accuracy: 0.820400 Epoch 68, CIFAR-10 Batch 2: Loss: 0.2242 Validation Accuracy: 0.843000 Epoch 68, CIFAR-10 Batch 3: Loss: 0.1916 Validation Accuracy: 0.812000 Epoch 68, CIFAR-10 Batch 4: Loss: 0.2289 Validation Accuracy: 0.853800 Epoch 68, CIFAR-10 Batch 5: Loss: 0.1853 Validation Accuracy: 0.824200 Epoch 69, CIFAR-10 Batch 1: Loss: 0.2080 Validation Accuracy: 0.840200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.2082 Validation Accuracy: 0.831200 Epoch 69, CIFAR-10 Batch 3: Loss: 0.1978 Validation Accuracy: 0.833600 Epoch 69, CIFAR-10 Batch 4: Loss: 0.2012 Validation Accuracy: 0.827600 Epoch 69, CIFAR-10 Batch 5: Loss: 0.2299 Validation Accuracy: 0.800400 Epoch 70, CIFAR-10 Batch 1: Loss: 0.2084 Validation Accuracy: 0.840000 Epoch 70, CIFAR-10 Batch 2: Loss: 0.2020 Validation Accuracy: 0.819800 Epoch 70, CIFAR-10 Batch 3: Loss: 0.1885 Validation Accuracy: 0.822800 Epoch 70, CIFAR-10 Batch 4: Loss: 0.2318 Validation Accuracy: 0.835800 Epoch 70, CIFAR-10 Batch 5: Loss: 0.2145 Validation Accuracy: 0.804600 Epoch 71, CIFAR-10 Batch 1: Loss: 0.1884 Validation Accuracy: 0.804000 Epoch 71, CIFAR-10 Batch 2: Loss: 0.2151 Validation Accuracy: 0.805800 Epoch 71, CIFAR-10 Batch 3: Loss: 0.1967 Validation Accuracy: 0.782800 Epoch 71, CIFAR-10 Batch 4: Loss: 0.1971 Validation Accuracy: 0.801600 Epoch 71, CIFAR-10 Batch 5: Loss: 0.2141 Validation Accuracy: 0.771400 Epoch 72, CIFAR-10 Batch 1: Loss: 0.2076 Validation Accuracy: 0.761400 Epoch 72, CIFAR-10 Batch 2: Loss: 0.2188 Validation Accuracy: 0.822800 Epoch 72, CIFAR-10 Batch 3: Loss: 0.2076 Validation Accuracy: 0.827200 Epoch 72, CIFAR-10 Batch 4: Loss: 0.2023 Validation Accuracy: 0.832600 Epoch 72, CIFAR-10 Batch 5: Loss: 0.2359 Validation Accuracy: 0.806000 Epoch 73, CIFAR-10 Batch 1: Loss: 0.2457 Validation Accuracy: 0.834400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.2149 Validation Accuracy: 0.814000 Epoch 73, CIFAR-10 Batch 3: Loss: 0.2161 Validation Accuracy: 0.840200 Epoch 73, CIFAR-10 Batch 4: Loss: 0.2065 Validation Accuracy: 0.792400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.1975 Validation Accuracy: 0.780200 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1914 Validation Accuracy: 0.821800 Epoch 74, CIFAR-10 Batch 2: Loss: 0.2221 Validation Accuracy: 0.826800 Epoch 74, CIFAR-10 Batch 3: Loss: 0.2056 Validation Accuracy: 0.801600 Epoch 74, CIFAR-10 Batch 4: Loss: 0.1865 Validation Accuracy: 0.799200 Epoch 74, CIFAR-10 Batch 5: Loss: 0.2440 Validation Accuracy: 0.789800 Epoch 75, CIFAR-10 Batch 1: Loss: 0.1815 Validation Accuracy: 0.836400 Epoch 75, CIFAR-10 Batch 2: Loss: 0.1986 Validation Accuracy: 0.827600 Epoch 75, CIFAR-10 Batch 3: Loss: 0.2248 Validation Accuracy: 0.804000 Epoch 75, CIFAR-10 Batch 4: Loss: 0.2001 Validation Accuracy: 0.842200 Epoch 75, CIFAR-10 Batch 5: Loss: 0.2080 Validation Accuracy: 0.813800 Epoch 76, CIFAR-10 Batch 1: Loss: 0.1826 Validation Accuracy: 0.853400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.1908 Validation Accuracy: 0.809000 Epoch 76, CIFAR-10 Batch 3: Loss: 0.1907 Validation Accuracy: 0.827000 Epoch 76, CIFAR-10 Batch 4: Loss: 0.2013 Validation Accuracy: 0.826000 Epoch 76, CIFAR-10 Batch 5: Loss: 0.1783 Validation Accuracy: 0.822800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.1926 Validation Accuracy: 0.833800 Epoch 77, CIFAR-10 Batch 2: Loss: 0.2295 Validation Accuracy: 0.817800 Epoch 77, CIFAR-10 Batch 3: Loss: 0.2136 Validation Accuracy: 0.819800 Epoch 77, CIFAR-10 Batch 4: Loss: 0.2006 Validation Accuracy: 0.818800 Epoch 77, CIFAR-10 Batch 5: Loss: 0.1788 Validation Accuracy: 0.794800 Epoch 78, CIFAR-10 Batch 1: Loss: 0.1904 Validation Accuracy: 0.796800 Epoch 78, CIFAR-10 Batch 2: Loss: 0.2005 Validation Accuracy: 0.806000 Epoch 78, CIFAR-10 Batch 3: Loss: 0.2092 Validation Accuracy: 0.798000 Epoch 78, CIFAR-10 Batch 4: Loss: 0.1874 Validation Accuracy: 0.849000 Epoch 78, CIFAR-10 Batch 5: Loss: 0.1986 Validation Accuracy: 0.831200 Epoch 79, CIFAR-10 Batch 1: Loss: 0.1990 Validation Accuracy: 0.788200 Epoch 79, CIFAR-10 Batch 2: Loss: 0.2282 Validation Accuracy: 0.825800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.1891 Validation Accuracy: 0.837400 Epoch 79, CIFAR-10 Batch 4: Loss: 0.2085 Validation Accuracy: 0.833800 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1917 Validation Accuracy: 0.743400 Epoch 80, CIFAR-10 Batch 1: Loss: 0.2079 Validation Accuracy: 0.810200 Epoch 80, CIFAR-10 Batch 2: Loss: 0.2384 Validation Accuracy: 0.809000 Epoch 80, CIFAR-10 Batch 3: Loss: 0.1955 Validation Accuracy: 0.831400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.1851 Validation Accuracy: 0.826200 Epoch 80, CIFAR-10 Batch 5: Loss: 0.1921 Validation Accuracy: 0.837800 Epoch 81, CIFAR-10 Batch 1: Loss: 0.2054 Validation Accuracy: 0.839200 Epoch 81, CIFAR-10 Batch 2: Loss: 0.2078 Validation Accuracy: 0.830600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.1899 Validation Accuracy: 0.829600 Epoch 81, CIFAR-10 Batch 4: Loss: 0.2073 Validation Accuracy: 0.825600 Epoch 81, CIFAR-10 Batch 5: Loss: 0.1979 Validation Accuracy: 0.815000 Epoch 82, CIFAR-10 Batch 1: Loss: 0.1823 Validation Accuracy: 0.873800 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1876 Validation Accuracy: 0.882600 Epoch 82, CIFAR-10 Batch 3: Loss: 0.1699 Validation Accuracy: 0.879800 Epoch 82, CIFAR-10 Batch 4: Loss: 0.1605 Validation Accuracy: 0.880200 Epoch 82, CIFAR-10 Batch 5: Loss: 0.1613 Validation Accuracy: 0.882400 Epoch 83, CIFAR-10 Batch 1: Loss: 0.1607 Validation Accuracy: 0.884600 Epoch 83, CIFAR-10 Batch 2: Loss: 0.1683 Validation Accuracy: 0.884600 Epoch 83, CIFAR-10 Batch 3: Loss: 0.1575 Validation Accuracy: 0.886400 Epoch 83, CIFAR-10 Batch 4: Loss: 0.1544 Validation Accuracy: 0.885400 Epoch 83, CIFAR-10 Batch 5: Loss: 0.1595 Validation Accuracy: 0.886600 Epoch 84, CIFAR-10 Batch 1: Loss: 0.1583 Validation Accuracy: 0.886400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.1666 Validation Accuracy: 0.885400 Epoch 84, CIFAR-10 Batch 3: Loss: 0.1564 Validation Accuracy: 0.886200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.1537 Validation Accuracy: 0.886000 Epoch 84, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 85, CIFAR-10 Batch 1: Loss: 0.1581 Validation Accuracy: 0.886600 Epoch 85, CIFAR-10 Batch 2: Loss: 0.1663 Validation Accuracy: 0.886600 Epoch 85, CIFAR-10 Batch 3: Loss: 0.1563 Validation Accuracy: 0.886000 Epoch 85, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 85, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.887200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.1581 Validation Accuracy: 0.886000 Epoch 86, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885400 Epoch 86, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 86, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 86, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 87, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 87, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885600 Epoch 87, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 87, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 87, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.885800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 88, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886800 Epoch 88, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 88, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 89, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 89, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 90, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 90, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 90, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 90, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 91, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 91, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 91, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.887400 Epoch 91, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 91, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 92, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 92, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 92, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 92, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 92, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 93, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 93, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 93, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 94, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 94, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 94, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 94, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 94, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 95, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 95, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 95, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 96, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 96, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 96, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 96, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 96, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886200 Epoch 97, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 97, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 97, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 97, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 97, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.887200 Epoch 98, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 98, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 98, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 98, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 98, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 99, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 99, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 99, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 99, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 100, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 100, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886800 Epoch 100, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 100, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 100, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 101, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 101, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 101, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 101, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 101, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 102, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 102, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 102, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 102, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 102, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 103, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 103, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 103, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 103, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 104, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 104, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 104, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 104, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 104, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 105, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 105, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 105, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 106, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 106, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 106, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 106, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 107, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 107, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 107, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 107, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 107, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 108, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 108, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886800 Epoch 108, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 108, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 108, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 109, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 109, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 109, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 109, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 109, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 110, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 110, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 110, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 110, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 110, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 111, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 111, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 111, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 111, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 112, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 112, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 112, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 112, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886000 Epoch 113, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 113, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 113, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 113, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 113, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 114, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 114, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 114, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 114, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 115, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 115, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 115, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 115, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 115, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 116, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 116, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 116, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 116, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886000 Epoch 117, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 117, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 117, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 117, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 117, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 118, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 118, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 118, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 118, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 119, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 119, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 119, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 119, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 119, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 120, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 120, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 120, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 120, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 121, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 121, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 121, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 121, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 121, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 122, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 122, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 122, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.887200 Epoch 122, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 122, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 123, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 123, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 123, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 123, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 123, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 124, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 124, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 124, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 124, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 124, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 125, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 125, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 125, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 125, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 125, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 126, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 126, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885600 Epoch 126, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 126, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 126, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 127, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 127, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 127, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 127, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 127, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 128, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 128, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.887000 Epoch 128, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 128, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 129, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 129, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 129, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 129, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 130, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 130, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 130, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 130, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 130, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 131, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 131, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 131, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 131, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886000 Epoch 132, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 132, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886800 Epoch 132, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 132, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 133, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 133, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 133, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 133, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886000 Epoch 134, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 134, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 134, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 134, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 135, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886800 Epoch 135, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 135, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 136, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 136, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 136, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 136, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886400 Epoch 136, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 137, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 137, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 137, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 137, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 138, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 138, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 138, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885600 Epoch 138, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 139, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 139, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 139, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 139, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 139, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 140, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 140, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886600 Epoch 140, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886600 Epoch 140, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 140, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886200 Epoch 141, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 141, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 141, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 141, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 141, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 142, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 142, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 142, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 142, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886200 Epoch 143, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886600 Epoch 143, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 143, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 143, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 143, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 144, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 144, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 144, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.885800 Epoch 144, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 144, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 145, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 145, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885600 Epoch 145, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 145, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 146, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 146, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 146, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 146, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 146, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 147, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 147, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 147, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 147, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 147, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 148, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 148, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 148, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 148, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 149, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 149, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 149, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 149, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 149, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 150, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 150, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 150, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 150, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 151, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 151, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 151, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 151, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 152, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 152, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 152, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 152, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886000 Epoch 153, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 153, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 153, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 153, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 153, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 154, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 154, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 154, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 154, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 155, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 155, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 155, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886800 Epoch 156, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 156, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 156, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 156, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 157, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 157, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 157, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886000 Epoch 157, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 157, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 158, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 158, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 158, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 158, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 158, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 159, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 159, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 159, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886600 Epoch 159, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Epoch 160, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 160, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 160, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 160, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.885800 Epoch 160, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 161, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.885800 Epoch 161, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 161, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 161, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886800 Epoch 162, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 162, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 162, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 162, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 163, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886000 Epoch 163, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 163, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886200 Epoch 163, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886200 Epoch 163, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.1580 Validation Accuracy: 0.886400 Epoch 164, CIFAR-10 Batch 2: Loss: 0.1662 Validation Accuracy: 0.886200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.1562 Validation Accuracy: 0.886400 Epoch 164, CIFAR-10 Batch 4: Loss: 0.1536 Validation Accuracy: 0.886000 Epoch 164, CIFAR-10 Batch 5: Loss: 0.1591 Validation Accuracy: 0.886600 Training for learning_rate=0.00100, batch_size=64 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.5575 Validation Accuracy: 0.241200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.6113 Validation Accuracy: 0.309000 Epoch 1, CIFAR-10 Batch 3: Loss: 1.2959 Validation Accuracy: 0.531400 Epoch 1, CIFAR-10 Batch 4: Loss: 1.1228 Validation Accuracy: 0.577800 Epoch 1, CIFAR-10 Batch 5: Loss: 1.2239 Validation Accuracy: 0.562400 Epoch 2, CIFAR-10 Batch 1: Loss: 0.9954 Validation Accuracy: 0.552600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.1095 Validation Accuracy: 0.474000 Epoch 2, CIFAR-10 Batch 3: Loss: 0.8528 Validation Accuracy: 0.614600 Epoch 2, CIFAR-10 Batch 4: Loss: 0.8387 Validation Accuracy: 0.663400 Epoch 2, CIFAR-10 Batch 5: Loss: 0.8604 Validation Accuracy: 0.645200 Epoch 3, CIFAR-10 Batch 1: Loss: 0.7660 Validation Accuracy: 0.644400 Epoch 3, CIFAR-10 Batch 2: Loss: 0.7798 Validation Accuracy: 0.707400 Epoch 3, CIFAR-10 Batch 3: Loss: 0.6630 Validation Accuracy: 0.659200 Epoch 3, CIFAR-10 Batch 4: Loss: 0.6675 Validation Accuracy: 0.719800 Epoch 3, CIFAR-10 Batch 5: Loss: 0.6420 Validation Accuracy: 0.700200 Epoch 4, CIFAR-10 Batch 1: Loss: 0.6357 Validation Accuracy: 0.719200 Epoch 4, CIFAR-10 Batch 2: Loss: 0.6350 Validation Accuracy: 0.719200 Epoch 4, CIFAR-10 Batch 3: Loss: 0.5448 Validation Accuracy: 0.698200 Epoch 4, CIFAR-10 Batch 4: Loss: 0.5680 Validation Accuracy: 0.719800 Epoch 4, CIFAR-10 Batch 5: Loss: 0.5004 Validation Accuracy: 0.717600 Epoch 5, CIFAR-10 Batch 1: Loss: 0.6144 Validation Accuracy: 0.746600 Epoch 5, CIFAR-10 Batch 2: Loss: 0.5485 Validation Accuracy: 0.760200 Epoch 5, CIFAR-10 Batch 3: Loss: 0.4339 Validation Accuracy: 0.733000 Epoch 5, CIFAR-10 Batch 4: Loss: 0.4908 Validation Accuracy: 0.736400 Epoch 5, CIFAR-10 Batch 5: Loss: 0.3507 Validation Accuracy: 0.753000 Epoch 6, CIFAR-10 Batch 1: Loss: 0.5023 Validation Accuracy: 0.746600 Epoch 6, CIFAR-10 Batch 2: Loss: 0.4668 Validation Accuracy: 0.767200 Epoch 6, CIFAR-10 Batch 3: Loss: 0.4029 Validation Accuracy: 0.788000 Epoch 6, CIFAR-10 Batch 4: Loss: 0.4388 Validation Accuracy: 0.772400 Epoch 6, CIFAR-10 Batch 5: Loss: 0.3862 Validation Accuracy: 0.755600 Epoch 7, CIFAR-10 Batch 1: Loss: 0.4269 Validation Accuracy: 0.747600 Epoch 7, CIFAR-10 Batch 2: Loss: 0.3666 Validation Accuracy: 0.725000 Epoch 7, CIFAR-10 Batch 3: Loss: 0.3357 Validation Accuracy: 0.800400 Epoch 7, CIFAR-10 Batch 4: Loss: 0.4512 Validation Accuracy: 0.766000 Epoch 7, CIFAR-10 Batch 5: Loss: 0.2713 Validation Accuracy: 0.813000 Epoch 8, CIFAR-10 Batch 1: Loss: 0.3646 Validation Accuracy: 0.796000 Epoch 8, CIFAR-10 Batch 2: Loss: 0.3512 Validation Accuracy: 0.787400 Epoch 8, CIFAR-10 Batch 3: Loss: 0.3488 Validation Accuracy: 0.795600 Epoch 8, CIFAR-10 Batch 4: Loss: 0.3593 Validation Accuracy: 0.776200 Epoch 8, CIFAR-10 Batch 5: Loss: 0.2792 Validation Accuracy: 0.767000 Epoch 9, CIFAR-10 Batch 1: Loss: 0.3989 Validation Accuracy: 0.794600 Epoch 9, CIFAR-10 Batch 2: Loss: 0.2721 Validation Accuracy: 0.827400 Epoch 9, CIFAR-10 Batch 3: Loss: 0.2963 Validation Accuracy: 0.822400 Epoch 9, CIFAR-10 Batch 4: Loss: 0.3545 Validation Accuracy: 0.824000 Epoch 9, CIFAR-10 Batch 5: Loss: 0.2234 Validation Accuracy: 0.811000 Epoch 10, CIFAR-10 Batch 1: Loss: 0.3543 Validation Accuracy: 0.813400 Epoch 10, CIFAR-10 Batch 2: Loss: 0.2727 Validation Accuracy: 0.756200 Epoch 10, CIFAR-10 Batch 3: Loss: 0.2647 Validation Accuracy: 0.787800 Epoch 10, CIFAR-10 Batch 4: Loss: 0.2962 Validation Accuracy: 0.805400 Epoch 10, CIFAR-10 Batch 5: Loss: 0.2292 Validation Accuracy: 0.814400 Epoch 11, CIFAR-10 Batch 1: Loss: 0.3263 Validation Accuracy: 0.781400 Epoch 11, CIFAR-10 Batch 2: Loss: 0.2451 Validation Accuracy: 0.762800 Epoch 11, CIFAR-10 Batch 3: Loss: 0.2696 Validation Accuracy: 0.779800 Epoch 11, CIFAR-10 Batch 4: Loss: 0.3116 Validation Accuracy: 0.779000 Epoch 11, CIFAR-10 Batch 5: Loss: 0.1934 Validation Accuracy: 0.823600 Epoch 12, CIFAR-10 Batch 1: Loss: 0.2351 Validation Accuracy: 0.806600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.1994 Validation Accuracy: 0.812800 Epoch 12, CIFAR-10 Batch 3: Loss: 0.2457 Validation Accuracy: 0.824800 Epoch 12, CIFAR-10 Batch 4: Loss: 0.2935 Validation Accuracy: 0.779600 Epoch 12, CIFAR-10 Batch 5: Loss: 0.2016 Validation Accuracy: 0.827800 Epoch 13, CIFAR-10 Batch 1: Loss: 0.2457 Validation Accuracy: 0.830600 Epoch 13, CIFAR-10 Batch 2: Loss: 0.2068 Validation Accuracy: 0.755000 Epoch 13, CIFAR-10 Batch 3: Loss: 0.1966 Validation Accuracy: 0.836400 Epoch 13, CIFAR-10 Batch 4: Loss: 0.2401 Validation Accuracy: 0.798400 Epoch 13, CIFAR-10 Batch 5: Loss: 0.1554 Validation Accuracy: 0.836600 Epoch 14, CIFAR-10 Batch 1: Loss: 0.2498 Validation Accuracy: 0.816000 Epoch 14, CIFAR-10 Batch 2: Loss: 0.1996 Validation Accuracy: 0.842800 Epoch 14, CIFAR-10 Batch 3: Loss: 0.1483 Validation Accuracy: 0.847000 Epoch 14, CIFAR-10 Batch 4: Loss: 0.2472 Validation Accuracy: 0.792200 Epoch 14, CIFAR-10 Batch 5: Loss: 0.1284 Validation Accuracy: 0.836200 Epoch 15, CIFAR-10 Batch 1: Loss: 0.1677 Validation Accuracy: 0.841400 Epoch 15, CIFAR-10 Batch 2: Loss: 0.1389 Validation Accuracy: 0.855600 Epoch 15, CIFAR-10 Batch 3: Loss: 0.1487 Validation Accuracy: 0.835000 Epoch 15, CIFAR-10 Batch 4: Loss: 0.2252 Validation Accuracy: 0.854000 Epoch 15, CIFAR-10 Batch 5: Loss: 0.1358 Validation Accuracy: 0.794000 Epoch 16, CIFAR-10 Batch 1: Loss: 0.1568 Validation Accuracy: 0.853000 Epoch 16, CIFAR-10 Batch 2: Loss: 0.1707 Validation Accuracy: 0.842000 Epoch 16, CIFAR-10 Batch 3: Loss: 0.1703 Validation Accuracy: 0.786600 Epoch 16, CIFAR-10 Batch 4: Loss: 0.1740 Validation Accuracy: 0.826800 Epoch 16, CIFAR-10 Batch 5: Loss: 0.1146 Validation Accuracy: 0.831400 Epoch 17, CIFAR-10 Batch 1: Loss: 0.1489 Validation Accuracy: 0.817200 Epoch 17, CIFAR-10 Batch 2: Loss: 0.1466 Validation Accuracy: 0.847000 Epoch 17, CIFAR-10 Batch 3: Loss: 0.1398 Validation Accuracy: 0.828600 Epoch 17, CIFAR-10 Batch 4: Loss: 0.1851 Validation Accuracy: 0.820400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.1133 Validation Accuracy: 0.812800 Epoch 18, CIFAR-10 Batch 1: Loss: 0.1483 Validation Accuracy: 0.820200 Epoch 18, CIFAR-10 Batch 2: Loss: 0.1499 Validation Accuracy: 0.846200 Epoch 18, CIFAR-10 Batch 3: Loss: 0.1746 Validation Accuracy: 0.819000 Epoch 18, CIFAR-10 Batch 4: Loss: 0.1969 Validation Accuracy: 0.829200 Epoch 18, CIFAR-10 Batch 5: Loss: 0.1236 Validation Accuracy: 0.847000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.1743 Validation Accuracy: 0.789000 Epoch 19, CIFAR-10 Batch 2: Loss: 0.1271 Validation Accuracy: 0.826200 Epoch 19, CIFAR-10 Batch 3: Loss: 0.1516 Validation Accuracy: 0.810800 Epoch 19, CIFAR-10 Batch 4: Loss: 0.1684 Validation Accuracy: 0.843800 Epoch 19, CIFAR-10 Batch 5: Loss: 0.1050 Validation Accuracy: 0.821000 Epoch 20, CIFAR-10 Batch 1: Loss: 0.1449 Validation Accuracy: 0.797200 Epoch 20, CIFAR-10 Batch 2: Loss: 0.1349 Validation Accuracy: 0.844400 Epoch 20, CIFAR-10 Batch 3: Loss: 0.1224 Validation Accuracy: 0.861600 Epoch 20, CIFAR-10 Batch 4: Loss: 0.1386 Validation Accuracy: 0.844800 Epoch 20, CIFAR-10 Batch 5: Loss: 0.1001 Validation Accuracy: 0.825800 Epoch 21, CIFAR-10 Batch 1: Loss: 0.1276 Validation Accuracy: 0.846200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.1360 Validation Accuracy: 0.853800 Epoch 21, CIFAR-10 Batch 3: Loss: 0.1158 Validation Accuracy: 0.855200 Epoch 21, CIFAR-10 Batch 4: Loss: 0.1947 Validation Accuracy: 0.854200 Epoch 21, CIFAR-10 Batch 5: Loss: 0.1061 Validation Accuracy: 0.863200 Epoch 22, CIFAR-10 Batch 1: Loss: 0.1256 Validation Accuracy: 0.856200 Epoch 22, CIFAR-10 Batch 2: Loss: 0.1414 Validation Accuracy: 0.853000 Epoch 22, CIFAR-10 Batch 3: Loss: 0.1267 Validation Accuracy: 0.816400 Epoch 22, CIFAR-10 Batch 4: Loss: 0.1354 Validation Accuracy: 0.846400 Epoch 22, CIFAR-10 Batch 5: Loss: 0.1006 Validation Accuracy: 0.863000 Epoch 23, CIFAR-10 Batch 1: Loss: 0.1255 Validation Accuracy: 0.708200 Epoch 23, CIFAR-10 Batch 2: Loss: 0.1148 Validation Accuracy: 0.869400 Epoch 23, CIFAR-10 Batch 3: Loss: 0.1049 Validation Accuracy: 0.829800 Epoch 23, CIFAR-10 Batch 4: Loss: 0.1546 Validation Accuracy: 0.869400 Epoch 23, CIFAR-10 Batch 5: Loss: 0.1026 Validation Accuracy: 0.790200 Epoch 24, CIFAR-10 Batch 1: Loss: 0.1092 Validation Accuracy: 0.847200 Epoch 24, CIFAR-10 Batch 2: Loss: 0.1235 Validation Accuracy: 0.835600 Epoch 24, CIFAR-10 Batch 3: Loss: 0.1069 Validation Accuracy: 0.791800 Epoch 24, CIFAR-10 Batch 4: Loss: 0.1547 Validation Accuracy: 0.837800 Epoch 24, CIFAR-10 Batch 5: Loss: 0.1027 Validation Accuracy: 0.829400 Epoch 25, CIFAR-10 Batch 1: Loss: 0.1345 Validation Accuracy: 0.833200 Epoch 25, CIFAR-10 Batch 2: Loss: 0.1245 Validation Accuracy: 0.841800 Epoch 25, CIFAR-10 Batch 3: Loss: 0.1091 Validation Accuracy: 0.809800 Epoch 25, CIFAR-10 Batch 4: Loss: 0.1573 Validation Accuracy: 0.860400 Epoch 25, CIFAR-10 Batch 5: Loss: 0.1016 Validation Accuracy: 0.866600 Epoch 26, CIFAR-10 Batch 1: Loss: 0.1147 Validation Accuracy: 0.796200 Epoch 26, CIFAR-10 Batch 2: Loss: 0.1058 Validation Accuracy: 0.844800 Epoch 26, CIFAR-10 Batch 3: Loss: 0.1063 Validation Accuracy: 0.813800 Epoch 26, CIFAR-10 Batch 4: Loss: 0.1194 Validation Accuracy: 0.832800 Epoch 26, CIFAR-10 Batch 5: Loss: 0.1038 Validation Accuracy: 0.851400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.1199 Validation Accuracy: 0.834200 Epoch 27, CIFAR-10 Batch 2: Loss: 0.1290 Validation Accuracy: 0.827800 Epoch 27, CIFAR-10 Batch 3: Loss: 0.1082 Validation Accuracy: 0.817600 Epoch 27, CIFAR-10 Batch 4: Loss: 0.1188 Validation Accuracy: 0.854400 Epoch 27, CIFAR-10 Batch 5: Loss: 0.1024 Validation Accuracy: 0.837800 Epoch 28, CIFAR-10 Batch 1: Loss: 0.1065 Validation Accuracy: 0.847600 Epoch 28, CIFAR-10 Batch 2: Loss: 0.1246 Validation Accuracy: 0.844200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.1216 Validation Accuracy: 0.863600 Epoch 28, CIFAR-10 Batch 4: Loss: 0.1098 Validation Accuracy: 0.858200 Epoch 28, CIFAR-10 Batch 5: Loss: 0.1008 Validation Accuracy: 0.855200 Epoch 29, CIFAR-10 Batch 1: Loss: 0.1003 Validation Accuracy: 0.850000 Epoch 29, CIFAR-10 Batch 2: Loss: 0.1320 Validation Accuracy: 0.853200 Epoch 29, CIFAR-10 Batch 3: Loss: 0.1225 Validation Accuracy: 0.845200 Epoch 29, CIFAR-10 Batch 4: Loss: 0.1132 Validation Accuracy: 0.830000 Epoch 29, CIFAR-10 Batch 5: Loss: 0.1060 Validation Accuracy: 0.854400 Epoch 30, CIFAR-10 Batch 1: Loss: 0.1125 Validation Accuracy: 0.855400 Epoch 30, CIFAR-10 Batch 2: Loss: 0.1175 Validation Accuracy: 0.856400 Epoch 30, CIFAR-10 Batch 3: Loss: 0.1113 Validation Accuracy: 0.827000 Epoch 30, CIFAR-10 Batch 4: Loss: 0.1199 Validation Accuracy: 0.860000 Epoch 30, CIFAR-10 Batch 5: Loss: 0.1057 Validation Accuracy: 0.857800 Epoch 31, CIFAR-10 Batch 1: Loss: 0.1090 Validation Accuracy: 0.816000 Epoch 31, CIFAR-10 Batch 2: Loss: 0.1184 Validation Accuracy: 0.816000 Epoch 31, CIFAR-10 Batch 3: Loss: 0.1048 Validation Accuracy: 0.846000 Epoch 31, CIFAR-10 Batch 4: Loss: 0.1220 Validation Accuracy: 0.822600 Epoch 31, CIFAR-10 Batch 5: Loss: 0.1067 Validation Accuracy: 0.846600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.1140 Validation Accuracy: 0.844800 Epoch 32, CIFAR-10 Batch 2: Loss: 0.1119 Validation Accuracy: 0.876000 Epoch 32, CIFAR-10 Batch 3: Loss: 0.1069 Validation Accuracy: 0.843600 Epoch 32, CIFAR-10 Batch 4: Loss: 0.1250 Validation Accuracy: 0.838800 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1049 Validation Accuracy: 0.847400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.1048 Validation Accuracy: 0.806800 Epoch 33, CIFAR-10 Batch 2: Loss: 0.1056 Validation Accuracy: 0.843600 Epoch 33, CIFAR-10 Batch 3: Loss: 0.1077 Validation Accuracy: 0.841200 Epoch 33, CIFAR-10 Batch 4: Loss: 0.1073 Validation Accuracy: 0.850400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1028 Validation Accuracy: 0.868000 Epoch 34, CIFAR-10 Batch 1: Loss: 0.1177 Validation Accuracy: 0.812600 Epoch 34, CIFAR-10 Batch 2: Loss: 0.1243 Validation Accuracy: 0.866400 Epoch 34, CIFAR-10 Batch 3: Loss: 0.1012 Validation Accuracy: 0.850800 Epoch 34, CIFAR-10 Batch 4: Loss: 0.1140 Validation Accuracy: 0.862800 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1023 Validation Accuracy: 0.843600 Epoch 35, CIFAR-10 Batch 1: Loss: 0.1035 Validation Accuracy: 0.837600 Epoch 35, CIFAR-10 Batch 2: Loss: 0.1125 Validation Accuracy: 0.866800 Epoch 35, CIFAR-10 Batch 3: Loss: 0.1033 Validation Accuracy: 0.861200 Epoch 35, CIFAR-10 Batch 4: Loss: 0.1111 Validation Accuracy: 0.852200 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1008 Validation Accuracy: 0.848000 Epoch 36, CIFAR-10 Batch 1: Loss: 0.1047 Validation Accuracy: 0.863000 Epoch 36, CIFAR-10 Batch 2: Loss: 0.1120 Validation Accuracy: 0.858200 Epoch 36, CIFAR-10 Batch 3: Loss: 0.1016 Validation Accuracy: 0.872200 Epoch 36, CIFAR-10 Batch 4: Loss: 0.1195 Validation Accuracy: 0.858400 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1118 Validation Accuracy: 0.832000 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1070 Validation Accuracy: 0.863000 Epoch 37, CIFAR-10 Batch 2: Loss: 0.1233 Validation Accuracy: 0.876200 Epoch 37, CIFAR-10 Batch 3: Loss: 0.1175 Validation Accuracy: 0.865400 Epoch 37, CIFAR-10 Batch 4: Loss: 0.1184 Validation Accuracy: 0.829800 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1006 Validation Accuracy: 0.855400 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1094 Validation Accuracy: 0.853000 Epoch 38, CIFAR-10 Batch 2: Loss: 0.1121 Validation Accuracy: 0.862000 Epoch 38, CIFAR-10 Batch 3: Loss: 0.1110 Validation Accuracy: 0.856400 Epoch 38, CIFAR-10 Batch 4: Loss: 0.1110 Validation Accuracy: 0.850600 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1003 Validation Accuracy: 0.861400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1025 Validation Accuracy: 0.866200 Epoch 39, CIFAR-10 Batch 2: Loss: 0.1056 Validation Accuracy: 0.865400 Epoch 39, CIFAR-10 Batch 3: Loss: 0.1036 Validation Accuracy: 0.856800 Epoch 39, CIFAR-10 Batch 4: Loss: 0.1065 Validation Accuracy: 0.847800 Epoch 39, CIFAR-10 Batch 5: Loss: 0.0995 Validation Accuracy: 0.872400 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1086 Validation Accuracy: 0.850600 Epoch 40, CIFAR-10 Batch 2: Loss: 0.1116 Validation Accuracy: 0.858200 Epoch 40, CIFAR-10 Batch 3: Loss: 0.1038 Validation Accuracy: 0.878000 Epoch 40, CIFAR-10 Batch 4: Loss: 0.1115 Validation Accuracy: 0.859000 Epoch 40, CIFAR-10 Batch 5: Loss: 0.0987 Validation Accuracy: 0.870600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1121 Validation Accuracy: 0.864800 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1090 Validation Accuracy: 0.869600 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1007 Validation Accuracy: 0.866600 Epoch 41, CIFAR-10 Batch 4: Loss: 0.1197 Validation Accuracy: 0.856600 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1004 Validation Accuracy: 0.847000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1021 Validation Accuracy: 0.871600 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1096 Validation Accuracy: 0.838600 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1034 Validation Accuracy: 0.858600 Epoch 42, CIFAR-10 Batch 4: Loss: 0.1062 Validation Accuracy: 0.858600 Epoch 42, CIFAR-10 Batch 5: Loss: 0.0988 Validation Accuracy: 0.868200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1013 Validation Accuracy: 0.862800 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1075 Validation Accuracy: 0.864200 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1038 Validation Accuracy: 0.837400 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1207 Validation Accuracy: 0.865000 Epoch 43, CIFAR-10 Batch 5: Loss: 0.1041 Validation Accuracy: 0.861000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1035 Validation Accuracy: 0.862600 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1104 Validation Accuracy: 0.871400 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1058 Validation Accuracy: 0.872600 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1036 Validation Accuracy: 0.861600 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0995 Validation Accuracy: 0.865000 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1019 Validation Accuracy: 0.861400 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1043 Validation Accuracy: 0.844400 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1013 Validation Accuracy: 0.856400 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1029 Validation Accuracy: 0.835000 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0990 Validation Accuracy: 0.846600 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1024 Validation Accuracy: 0.862000 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1039 Validation Accuracy: 0.836400 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1045 Validation Accuracy: 0.871600 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1019 Validation Accuracy: 0.861400 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0983 Validation Accuracy: 0.840800 Epoch 47, CIFAR-10 Batch 1: Loss: 0.0987 Validation Accuracy: 0.847600 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1064 Validation Accuracy: 0.871800 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1079 Validation Accuracy: 0.855600 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1132 Validation Accuracy: 0.863200 Epoch 47, CIFAR-10 Batch 5: Loss: 0.1037 Validation Accuracy: 0.851000 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1028 Validation Accuracy: 0.846400 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1053 Validation Accuracy: 0.872400 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1343 Validation Accuracy: 0.866800 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1043 Validation Accuracy: 0.865400 Epoch 48, CIFAR-10 Batch 5: Loss: 0.1010 Validation Accuracy: 0.857000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.1210 Validation Accuracy: 0.868600 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1038 Validation Accuracy: 0.863000 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1023 Validation Accuracy: 0.856000 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1103 Validation Accuracy: 0.874400 Epoch 49, CIFAR-10 Batch 5: Loss: 0.1006 Validation Accuracy: 0.848600 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1034 Validation Accuracy: 0.870400 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1016 Validation Accuracy: 0.866000 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1008 Validation Accuracy: 0.841000 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1037 Validation Accuracy: 0.884400 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0987 Validation Accuracy: 0.868600 Epoch 51, CIFAR-10 Batch 1: Loss: 0.1023 Validation Accuracy: 0.874200 Epoch 51, CIFAR-10 Batch 2: Loss: 0.0990 Validation Accuracy: 0.854800 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1043 Validation Accuracy: 0.863200 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1040 Validation Accuracy: 0.869400 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0980 Validation Accuracy: 0.855400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.1001 Validation Accuracy: 0.865600 Epoch 52, CIFAR-10 Batch 2: Loss: 0.0993 Validation Accuracy: 0.850800 Epoch 52, CIFAR-10 Batch 3: Loss: 0.1179 Validation Accuracy: 0.868000 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1068 Validation Accuracy: 0.868600 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0974 Validation Accuracy: 0.822000 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0979 Validation Accuracy: 0.825000 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1066 Validation Accuracy: 0.868200 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1061 Validation Accuracy: 0.872600 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1030 Validation Accuracy: 0.869800 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0979 Validation Accuracy: 0.843400 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0998 Validation Accuracy: 0.851800 Epoch 54, CIFAR-10 Batch 2: Loss: 0.0992 Validation Accuracy: 0.843000 Epoch 54, CIFAR-10 Batch 3: Loss: 0.1006 Validation Accuracy: 0.867000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1063 Validation Accuracy: 0.872000 Epoch 54, CIFAR-10 Batch 5: Loss: 0.1003 Validation Accuracy: 0.851600 Epoch 55, CIFAR-10 Batch 1: Loss: 0.1049 Validation Accuracy: 0.871200 Epoch 55, CIFAR-10 Batch 2: Loss: 0.1030 Validation Accuracy: 0.885600 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0983 Validation Accuracy: 0.854200 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1037 Validation Accuracy: 0.866800 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0993 Validation Accuracy: 0.864200 Epoch 56, CIFAR-10 Batch 1: Loss: 0.1011 Validation Accuracy: 0.842600 Epoch 56, CIFAR-10 Batch 2: Loss: 0.0997 Validation Accuracy: 0.847400 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0997 Validation Accuracy: 0.874000 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1073 Validation Accuracy: 0.880800 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0973 Validation Accuracy: 0.877600 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0983 Validation Accuracy: 0.857800 Epoch 57, CIFAR-10 Batch 2: Loss: 0.1009 Validation Accuracy: 0.870200 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0977 Validation Accuracy: 0.888200 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1017 Validation Accuracy: 0.870200 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0971 Validation Accuracy: 0.871600 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0992 Validation Accuracy: 0.861600 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0992 Validation Accuracy: 0.873400 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0989 Validation Accuracy: 0.866400 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1052 Validation Accuracy: 0.873000 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0967 Validation Accuracy: 0.858200 Epoch 59, CIFAR-10 Batch 1: Loss: 0.1019 Validation Accuracy: 0.864200 Epoch 59, CIFAR-10 Batch 2: Loss: 0.1015 Validation Accuracy: 0.866000 Epoch 59, CIFAR-10 Batch 3: Loss: 0.1010 Validation Accuracy: 0.853200 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1082 Validation Accuracy: 0.874200 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0974 Validation Accuracy: 0.879400 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0995 Validation Accuracy: 0.877200 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0977 Validation Accuracy: 0.870600 Epoch 60, CIFAR-10 Batch 3: Loss: 0.0989 Validation Accuracy: 0.872600 Epoch 60, CIFAR-10 Batch 4: Loss: 0.0986 Validation Accuracy: 0.837000 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0995 Validation Accuracy: 0.861200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0968 Validation Accuracy: 0.888200 Epoch 61, CIFAR-10 Batch 2: Loss: 0.1001 Validation Accuracy: 0.858000 Epoch 61, CIFAR-10 Batch 3: Loss: 0.1005 Validation Accuracy: 0.874200 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0978 Validation Accuracy: 0.881800 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0965 Validation Accuracy: 0.852000 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0968 Validation Accuracy: 0.874600 Epoch 62, CIFAR-10 Batch 2: Loss: 0.1076 Validation Accuracy: 0.867200 Epoch 62, CIFAR-10 Batch 3: Loss: 0.1008 Validation Accuracy: 0.861600 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0975 Validation Accuracy: 0.851400 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0964 Validation Accuracy: 0.852800 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0974 Validation Accuracy: 0.879800 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0982 Validation Accuracy: 0.875200 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0983 Validation Accuracy: 0.864800 Epoch 63, CIFAR-10 Batch 4: Loss: 0.1009 Validation Accuracy: 0.845600 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0967 Validation Accuracy: 0.859600 Epoch 64, CIFAR-10 Batch 1: Loss: 0.1014 Validation Accuracy: 0.854400 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0991 Validation Accuracy: 0.867000 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0993 Validation Accuracy: 0.867800 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0971 Validation Accuracy: 0.870600 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0967 Validation Accuracy: 0.877200 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0968 Validation Accuracy: 0.871000 Epoch 65, CIFAR-10 Batch 2: Loss: 0.1050 Validation Accuracy: 0.882400 Epoch 65, CIFAR-10 Batch 3: Loss: 0.1043 Validation Accuracy: 0.876200 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0973 Validation Accuracy: 0.880000 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0969 Validation Accuracy: 0.844400 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0979 Validation Accuracy: 0.874200 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0979 Validation Accuracy: 0.864400 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0970 Validation Accuracy: 0.876400 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0973 Validation Accuracy: 0.864200 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0963 Validation Accuracy: 0.865600 Epoch 67, CIFAR-10 Batch 1: Loss: 0.1042 Validation Accuracy: 0.864600 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0984 Validation Accuracy: 0.860800 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0988 Validation Accuracy: 0.869400 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0994 Validation Accuracy: 0.849000 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0959 Validation Accuracy: 0.867800 Epoch 68, CIFAR-10 Batch 1: Loss: 0.1178 Validation Accuracy: 0.875600 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0966 Validation Accuracy: 0.875600 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0987 Validation Accuracy: 0.860600 Epoch 68, CIFAR-10 Batch 4: Loss: 0.1000 Validation Accuracy: 0.873800 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0961 Validation Accuracy: 0.871200 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0973 Validation Accuracy: 0.868400 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0956 Validation Accuracy: 0.881200 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0968 Validation Accuracy: 0.872400 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0963 Validation Accuracy: 0.863200 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0947 Validation Accuracy: 0.866600 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0986 Validation Accuracy: 0.868200 Epoch 70, CIFAR-10 Batch 2: Loss: 0.1001 Validation Accuracy: 0.858000 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0959 Validation Accuracy: 0.880400 Epoch 70, CIFAR-10 Batch 4: Loss: 0.1021 Validation Accuracy: 0.880600 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0940 Validation Accuracy: 0.871800 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0948 Validation Accuracy: 0.845000 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0963 Validation Accuracy: 0.872400 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0965 Validation Accuracy: 0.871200 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0954 Validation Accuracy: 0.875800 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0952 Validation Accuracy: 0.882000 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0942 Validation Accuracy: 0.873800 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0960 Validation Accuracy: 0.884200 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0948 Validation Accuracy: 0.844600 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0980 Validation Accuracy: 0.858800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0950 Validation Accuracy: 0.865800 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0951 Validation Accuracy: 0.873400 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0956 Validation Accuracy: 0.883000 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0957 Validation Accuracy: 0.885000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0960 Validation Accuracy: 0.861400 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0939 Validation Accuracy: 0.844800 Epoch 74, CIFAR-10 Batch 1: Loss: 0.1020 Validation Accuracy: 0.883200 Epoch 74, CIFAR-10 Batch 2: Loss: 0.1013 Validation Accuracy: 0.873000 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0944 Validation Accuracy: 0.870200 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0942 Validation Accuracy: 0.866600 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0941 Validation Accuracy: 0.873800 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0972 Validation Accuracy: 0.874000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0950 Validation Accuracy: 0.871800 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0956 Validation Accuracy: 0.875000 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0959 Validation Accuracy: 0.870800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0932 Validation Accuracy: 0.865400 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0943 Validation Accuracy: 0.854000 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0981 Validation Accuracy: 0.892000 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0940 Validation Accuracy: 0.873800 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0951 Validation Accuracy: 0.878400 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0933 Validation Accuracy: 0.871000 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0946 Validation Accuracy: 0.847800 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0961 Validation Accuracy: 0.868600 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0952 Validation Accuracy: 0.869800 Epoch 77, CIFAR-10 Batch 4: Loss: 0.1035 Validation Accuracy: 0.868400 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0935 Validation Accuracy: 0.882000 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0939 Validation Accuracy: 0.855800 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0942 Validation Accuracy: 0.867200 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0957 Validation Accuracy: 0.855400 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0985 Validation Accuracy: 0.878400 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0926 Validation Accuracy: 0.881000 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0953 Validation Accuracy: 0.886400 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0954 Validation Accuracy: 0.870800 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0979 Validation Accuracy: 0.878400 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0950 Validation Accuracy: 0.872400 Epoch 79, CIFAR-10 Batch 5: Loss: 0.1013 Validation Accuracy: 0.873800 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0931 Validation Accuracy: 0.847600 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0954 Validation Accuracy: 0.882600 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0932 Validation Accuracy: 0.877600 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0942 Validation Accuracy: 0.874400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0960 Validation Accuracy: 0.876200 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0973 Validation Accuracy: 0.868600 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0967 Validation Accuracy: 0.872200 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0942 Validation Accuracy: 0.861600 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0989 Validation Accuracy: 0.887600 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0928 Validation Accuracy: 0.878600 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0919 Validation Accuracy: 0.898400 Epoch 82, CIFAR-10 Batch 2: Loss: 0.1014 Validation Accuracy: 0.901200 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0917 Validation Accuracy: 0.897600 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0911 Validation Accuracy: 0.899800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0907 Validation Accuracy: 0.902000 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0929 Validation Accuracy: 0.903400 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0909 Validation Accuracy: 0.902800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0907 Validation Accuracy: 0.903200 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0926 Validation Accuracy: 0.903200 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0926 Validation Accuracy: 0.903800 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903400 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903000 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903000 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903200 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902600 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903800 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902400 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904400 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903600 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904600 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903600 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903000 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903800 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903400 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903400 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904400 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902600 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904400 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903600 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902600 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903400 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903600 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.902800 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903400 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903800 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904000 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903200 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.902800 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.904200 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903200 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903600 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903000 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.903800 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904000 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.902800 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903400 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.903200 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0904 Validation Accuracy: 0.903800 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0925 Validation Accuracy: 0.904200 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0908 Validation Accuracy: 0.903000 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0906 Validation Accuracy: 0.903200 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0905 Validation Accuracy: 0.902800 Training for learning_rate=0.00010, batch_size=64 ... Epoch 1, CIFAR-10 Batch 1: Loss: 1.9036 Validation Accuracy: 0.155200 Epoch 1, CIFAR-10 Batch 2: Loss: 1.8908 Validation Accuracy: 0.249400 Epoch 1, CIFAR-10 Batch 3: Loss: 1.7428 Validation Accuracy: 0.344200 Epoch 1, CIFAR-10 Batch 4: Loss: 1.6144 Validation Accuracy: 0.395200 Epoch 1, CIFAR-10 Batch 5: Loss: 1.6021 Validation Accuracy: 0.436800 Epoch 2, CIFAR-10 Batch 1: Loss: 1.4266 Validation Accuracy: 0.439600 Epoch 2, CIFAR-10 Batch 2: Loss: 1.6971 Validation Accuracy: 0.445600 Epoch 2, CIFAR-10 Batch 3: Loss: 1.4181 Validation Accuracy: 0.520800 Epoch 2, CIFAR-10 Batch 4: Loss: 1.3852 Validation Accuracy: 0.543000 Epoch 2, CIFAR-10 Batch 5: Loss: 1.4335 Validation Accuracy: 0.475600 Epoch 3, CIFAR-10 Batch 1: Loss: 1.2976 Validation Accuracy: 0.491400 Epoch 3, CIFAR-10 Batch 2: Loss: 1.5898 Validation Accuracy: 0.485400 Epoch 3, CIFAR-10 Batch 3: Loss: 1.2171 Validation Accuracy: 0.578200 Epoch 3, CIFAR-10 Batch 4: Loss: 1.2600 Validation Accuracy: 0.562800 Epoch 3, CIFAR-10 Batch 5: Loss: 1.3037 Validation Accuracy: 0.506800 Epoch 4, CIFAR-10 Batch 1: Loss: 1.2136 Validation Accuracy: 0.524400 Epoch 4, CIFAR-10 Batch 2: Loss: 1.4843 Validation Accuracy: 0.539400 Epoch 4, CIFAR-10 Batch 3: Loss: 1.0708 Validation Accuracy: 0.624800 Epoch 4, CIFAR-10 Batch 4: Loss: 1.1765 Validation Accuracy: 0.589600 Epoch 4, CIFAR-10 Batch 5: Loss: 1.2210 Validation Accuracy: 0.520800 Epoch 5, CIFAR-10 Batch 1: Loss: 1.1460 Validation Accuracy: 0.537400 Epoch 5, CIFAR-10 Batch 2: Loss: 1.3629 Validation Accuracy: 0.556000 Epoch 5, CIFAR-10 Batch 3: Loss: 0.9450 Validation Accuracy: 0.601000 Epoch 5, CIFAR-10 Batch 4: Loss: 1.0788 Validation Accuracy: 0.608800 Epoch 5, CIFAR-10 Batch 5: Loss: 1.1066 Validation Accuracy: 0.558400 Epoch 6, CIFAR-10 Batch 1: Loss: 1.0574 Validation Accuracy: 0.570000 Epoch 6, CIFAR-10 Batch 2: Loss: 1.2897 Validation Accuracy: 0.611800 Epoch 6, CIFAR-10 Batch 3: Loss: 0.8542 Validation Accuracy: 0.636800 Epoch 6, CIFAR-10 Batch 4: Loss: 1.0078 Validation Accuracy: 0.605600 Epoch 6, CIFAR-10 Batch 5: Loss: 1.0678 Validation Accuracy: 0.564400 Epoch 7, CIFAR-10 Batch 1: Loss: 1.0120 Validation Accuracy: 0.578400 Epoch 7, CIFAR-10 Batch 2: Loss: 1.2366 Validation Accuracy: 0.611600 Epoch 7, CIFAR-10 Batch 3: Loss: 0.7856 Validation Accuracy: 0.672000 Epoch 7, CIFAR-10 Batch 4: Loss: 0.9546 Validation Accuracy: 0.643400 Epoch 7, CIFAR-10 Batch 5: Loss: 0.9775 Validation Accuracy: 0.597000 Epoch 8, CIFAR-10 Batch 1: Loss: 0.9583 Validation Accuracy: 0.603600 Epoch 8, CIFAR-10 Batch 2: Loss: 1.1441 Validation Accuracy: 0.658000 Epoch 8, CIFAR-10 Batch 3: Loss: 0.7040 Validation Accuracy: 0.671800 Epoch 8, CIFAR-10 Batch 4: Loss: 0.8839 Validation Accuracy: 0.691000 Epoch 8, CIFAR-10 Batch 5: Loss: 0.9049 Validation Accuracy: 0.606000 Epoch 9, CIFAR-10 Batch 1: Loss: 0.9195 Validation Accuracy: 0.595000 Epoch 9, CIFAR-10 Batch 2: Loss: 1.0636 Validation Accuracy: 0.679600 Epoch 9, CIFAR-10 Batch 3: Loss: 0.6651 Validation Accuracy: 0.713600 Epoch 9, CIFAR-10 Batch 4: Loss: 0.7998 Validation Accuracy: 0.681000 Epoch 9, CIFAR-10 Batch 5: Loss: 0.8526 Validation Accuracy: 0.613800 Epoch 10, CIFAR-10 Batch 1: Loss: 0.8511 Validation Accuracy: 0.642800 Epoch 10, CIFAR-10 Batch 2: Loss: 0.9612 Validation Accuracy: 0.689000 Epoch 10, CIFAR-10 Batch 3: Loss: 0.6298 Validation Accuracy: 0.738000 Epoch 10, CIFAR-10 Batch 4: Loss: 0.7421 Validation Accuracy: 0.707200 Epoch 10, CIFAR-10 Batch 5: Loss: 0.7941 Validation Accuracy: 0.664200 Epoch 11, CIFAR-10 Batch 1: Loss: 0.8070 Validation Accuracy: 0.634000 Epoch 11, CIFAR-10 Batch 2: Loss: 0.9348 Validation Accuracy: 0.710000 Epoch 11, CIFAR-10 Batch 3: Loss: 0.6037 Validation Accuracy: 0.733400 Epoch 11, CIFAR-10 Batch 4: Loss: 0.6949 Validation Accuracy: 0.699400 Epoch 11, CIFAR-10 Batch 5: Loss: 0.7547 Validation Accuracy: 0.653400 Epoch 12, CIFAR-10 Batch 1: Loss: 0.7440 Validation Accuracy: 0.634600 Epoch 12, CIFAR-10 Batch 2: Loss: 0.8608 Validation Accuracy: 0.719600 Epoch 12, CIFAR-10 Batch 3: Loss: 0.5979 Validation Accuracy: 0.748600 Epoch 12, CIFAR-10 Batch 4: Loss: 0.6765 Validation Accuracy: 0.734600 Epoch 12, CIFAR-10 Batch 5: Loss: 0.7204 Validation Accuracy: 0.670400 Epoch 13, CIFAR-10 Batch 1: Loss: 0.7542 Validation Accuracy: 0.668200 Epoch 13, CIFAR-10 Batch 2: Loss: 0.8105 Validation Accuracy: 0.725600 Epoch 13, CIFAR-10 Batch 3: Loss: 0.5425 Validation Accuracy: 0.742000 Epoch 13, CIFAR-10 Batch 4: Loss: 0.6514 Validation Accuracy: 0.742000 Epoch 13, CIFAR-10 Batch 5: Loss: 0.6218 Validation Accuracy: 0.676600 Epoch 14, CIFAR-10 Batch 1: Loss: 0.6796 Validation Accuracy: 0.687200 Epoch 14, CIFAR-10 Batch 2: Loss: 0.7373 Validation Accuracy: 0.718000 Epoch 14, CIFAR-10 Batch 3: Loss: 0.5323 Validation Accuracy: 0.762000 Epoch 14, CIFAR-10 Batch 4: Loss: 0.6173 Validation Accuracy: 0.735000 Epoch 14, CIFAR-10 Batch 5: Loss: 0.6131 Validation Accuracy: 0.718000 Epoch 15, CIFAR-10 Batch 1: Loss: 0.6124 Validation Accuracy: 0.701800 Epoch 15, CIFAR-10 Batch 2: Loss: 0.6933 Validation Accuracy: 0.710200 Epoch 15, CIFAR-10 Batch 3: Loss: 0.4999 Validation Accuracy: 0.748400 Epoch 15, CIFAR-10 Batch 4: Loss: 0.5588 Validation Accuracy: 0.748000 Epoch 15, CIFAR-10 Batch 5: Loss: 0.5661 Validation Accuracy: 0.691200 Epoch 16, CIFAR-10 Batch 1: Loss: 0.6018 Validation Accuracy: 0.695000 Epoch 16, CIFAR-10 Batch 2: Loss: 0.6738 Validation Accuracy: 0.731800 Epoch 16, CIFAR-10 Batch 3: Loss: 0.4941 Validation Accuracy: 0.750600 Epoch 16, CIFAR-10 Batch 4: Loss: 0.5440 Validation Accuracy: 0.758000 Epoch 16, CIFAR-10 Batch 5: Loss: 0.5298 Validation Accuracy: 0.720000 Epoch 17, CIFAR-10 Batch 1: Loss: 0.5547 Validation Accuracy: 0.717800 Epoch 17, CIFAR-10 Batch 2: Loss: 0.6132 Validation Accuracy: 0.722800 Epoch 17, CIFAR-10 Batch 3: Loss: 0.4646 Validation Accuracy: 0.777200 Epoch 17, CIFAR-10 Batch 4: Loss: 0.5245 Validation Accuracy: 0.749400 Epoch 17, CIFAR-10 Batch 5: Loss: 0.4687 Validation Accuracy: 0.707200 Epoch 18, CIFAR-10 Batch 1: Loss: 0.5518 Validation Accuracy: 0.691800 Epoch 18, CIFAR-10 Batch 2: Loss: 0.5604 Validation Accuracy: 0.767600 Epoch 18, CIFAR-10 Batch 3: Loss: 0.4479 Validation Accuracy: 0.765400 Epoch 18, CIFAR-10 Batch 4: Loss: 0.4915 Validation Accuracy: 0.769600 Epoch 18, CIFAR-10 Batch 5: Loss: 0.4310 Validation Accuracy: 0.745000 Epoch 19, CIFAR-10 Batch 1: Loss: 0.4927 Validation Accuracy: 0.739800 Epoch 19, CIFAR-10 Batch 2: Loss: 0.5419 Validation Accuracy: 0.763600 Epoch 19, CIFAR-10 Batch 3: Loss: 0.4408 Validation Accuracy: 0.774600 Epoch 19, CIFAR-10 Batch 4: Loss: 0.4974 Validation Accuracy: 0.776600 Epoch 19, CIFAR-10 Batch 5: Loss: 0.4349 Validation Accuracy: 0.746200 Epoch 20, CIFAR-10 Batch 1: Loss: 0.4899 Validation Accuracy: 0.735000 Epoch 20, CIFAR-10 Batch 2: Loss: 0.5056 Validation Accuracy: 0.757800 Epoch 20, CIFAR-10 Batch 3: Loss: 0.4201 Validation Accuracy: 0.759600 Epoch 20, CIFAR-10 Batch 4: Loss: 0.4790 Validation Accuracy: 0.783600 Epoch 20, CIFAR-10 Batch 5: Loss: 0.4047 Validation Accuracy: 0.736000 Epoch 21, CIFAR-10 Batch 1: Loss: 0.4269 Validation Accuracy: 0.719200 Epoch 21, CIFAR-10 Batch 2: Loss: 0.4618 Validation Accuracy: 0.778200 Epoch 21, CIFAR-10 Batch 3: Loss: 0.4093 Validation Accuracy: 0.762600 Epoch 21, CIFAR-10 Batch 4: Loss: 0.4574 Validation Accuracy: 0.764400 Epoch 21, CIFAR-10 Batch 5: Loss: 0.3650 Validation Accuracy: 0.755200 Epoch 22, CIFAR-10 Batch 1: Loss: 0.4029 Validation Accuracy: 0.764600 Epoch 22, CIFAR-10 Batch 2: Loss: 0.4644 Validation Accuracy: 0.782800 Epoch 22, CIFAR-10 Batch 3: Loss: 0.3839 Validation Accuracy: 0.795000 Epoch 22, CIFAR-10 Batch 4: Loss: 0.4494 Validation Accuracy: 0.767800 Epoch 22, CIFAR-10 Batch 5: Loss: 0.3560 Validation Accuracy: 0.758000 Epoch 23, CIFAR-10 Batch 1: Loss: 0.3608 Validation Accuracy: 0.785600 Epoch 23, CIFAR-10 Batch 2: Loss: 0.4259 Validation Accuracy: 0.777000 Epoch 23, CIFAR-10 Batch 3: Loss: 0.3535 Validation Accuracy: 0.800600 Epoch 23, CIFAR-10 Batch 4: Loss: 0.4242 Validation Accuracy: 0.755600 Epoch 23, CIFAR-10 Batch 5: Loss: 0.3413 Validation Accuracy: 0.761800 Epoch 24, CIFAR-10 Batch 1: Loss: 0.3698 Validation Accuracy: 0.753800 Epoch 24, CIFAR-10 Batch 2: Loss: 0.3958 Validation Accuracy: 0.776600 Epoch 24, CIFAR-10 Batch 3: Loss: 0.3416 Validation Accuracy: 0.778200 Epoch 24, CIFAR-10 Batch 4: Loss: 0.4041 Validation Accuracy: 0.774600 Epoch 24, CIFAR-10 Batch 5: Loss: 0.3176 Validation Accuracy: 0.758400 Epoch 25, CIFAR-10 Batch 1: Loss: 0.3868 Validation Accuracy: 0.760600 Epoch 25, CIFAR-10 Batch 2: Loss: 0.3699 Validation Accuracy: 0.775600 Epoch 25, CIFAR-10 Batch 3: Loss: 0.3391 Validation Accuracy: 0.797600 Epoch 25, CIFAR-10 Batch 4: Loss: 0.3945 Validation Accuracy: 0.773000 Epoch 25, CIFAR-10 Batch 5: Loss: 0.2881 Validation Accuracy: 0.751800 Epoch 26, CIFAR-10 Batch 1: Loss: 0.3392 Validation Accuracy: 0.781400 Epoch 26, CIFAR-10 Batch 2: Loss: 0.3540 Validation Accuracy: 0.782000 Epoch 26, CIFAR-10 Batch 3: Loss: 0.3174 Validation Accuracy: 0.784800 Epoch 26, CIFAR-10 Batch 4: Loss: 0.3525 Validation Accuracy: 0.783000 Epoch 26, CIFAR-10 Batch 5: Loss: 0.2686 Validation Accuracy: 0.768400 Epoch 27, CIFAR-10 Batch 1: Loss: 0.2952 Validation Accuracy: 0.762000 Epoch 27, CIFAR-10 Batch 2: Loss: 0.3258 Validation Accuracy: 0.761200 Epoch 27, CIFAR-10 Batch 3: Loss: 0.3109 Validation Accuracy: 0.788400 Epoch 27, CIFAR-10 Batch 4: Loss: 0.3466 Validation Accuracy: 0.779800 Epoch 27, CIFAR-10 Batch 5: Loss: 0.2563 Validation Accuracy: 0.739200 Epoch 28, CIFAR-10 Batch 1: Loss: 0.3076 Validation Accuracy: 0.753200 Epoch 28, CIFAR-10 Batch 2: Loss: 0.3095 Validation Accuracy: 0.754200 Epoch 28, CIFAR-10 Batch 3: Loss: 0.3139 Validation Accuracy: 0.806200 Epoch 28, CIFAR-10 Batch 4: Loss: 0.3327 Validation Accuracy: 0.799400 Epoch 28, CIFAR-10 Batch 5: Loss: 0.2305 Validation Accuracy: 0.775400 Epoch 29, CIFAR-10 Batch 1: Loss: 0.2804 Validation Accuracy: 0.774800 Epoch 29, CIFAR-10 Batch 2: Loss: 0.3220 Validation Accuracy: 0.796600 Epoch 29, CIFAR-10 Batch 3: Loss: 0.2701 Validation Accuracy: 0.787200 Epoch 29, CIFAR-10 Batch 4: Loss: 0.3318 Validation Accuracy: 0.818200 Epoch 29, CIFAR-10 Batch 5: Loss: 0.2317 Validation Accuracy: 0.782000 Epoch 30, CIFAR-10 Batch 1: Loss: 0.2921 Validation Accuracy: 0.771600 Epoch 30, CIFAR-10 Batch 2: Loss: 0.2822 Validation Accuracy: 0.781200 Epoch 30, CIFAR-10 Batch 3: Loss: 0.2817 Validation Accuracy: 0.796200 Epoch 30, CIFAR-10 Batch 4: Loss: 0.3188 Validation Accuracy: 0.750000 Epoch 30, CIFAR-10 Batch 5: Loss: 0.1968 Validation Accuracy: 0.779600 Epoch 31, CIFAR-10 Batch 1: Loss: 0.2877 Validation Accuracy: 0.778400 Epoch 31, CIFAR-10 Batch 2: Loss: 0.2832 Validation Accuracy: 0.808400 Epoch 31, CIFAR-10 Batch 3: Loss: 0.2879 Validation Accuracy: 0.811800 Epoch 31, CIFAR-10 Batch 4: Loss: 0.3006 Validation Accuracy: 0.813600 Epoch 31, CIFAR-10 Batch 5: Loss: 0.1801 Validation Accuracy: 0.797600 Epoch 32, CIFAR-10 Batch 1: Loss: 0.2623 Validation Accuracy: 0.760600 Epoch 32, CIFAR-10 Batch 2: Loss: 0.2745 Validation Accuracy: 0.780600 Epoch 32, CIFAR-10 Batch 3: Loss: 0.2450 Validation Accuracy: 0.807200 Epoch 32, CIFAR-10 Batch 4: Loss: 0.2898 Validation Accuracy: 0.779000 Epoch 32, CIFAR-10 Batch 5: Loss: 0.1895 Validation Accuracy: 0.809400 Epoch 33, CIFAR-10 Batch 1: Loss: 0.2282 Validation Accuracy: 0.771800 Epoch 33, CIFAR-10 Batch 2: Loss: 0.2383 Validation Accuracy: 0.797400 Epoch 33, CIFAR-10 Batch 3: Loss: 0.2500 Validation Accuracy: 0.831800 Epoch 33, CIFAR-10 Batch 4: Loss: 0.2908 Validation Accuracy: 0.774400 Epoch 33, CIFAR-10 Batch 5: Loss: 0.1761 Validation Accuracy: 0.804800 Epoch 34, CIFAR-10 Batch 1: Loss: 0.2466 Validation Accuracy: 0.797600 Epoch 34, CIFAR-10 Batch 2: Loss: 0.2641 Validation Accuracy: 0.783800 Epoch 34, CIFAR-10 Batch 3: Loss: 0.2617 Validation Accuracy: 0.815600 Epoch 34, CIFAR-10 Batch 4: Loss: 0.2667 Validation Accuracy: 0.795000 Epoch 34, CIFAR-10 Batch 5: Loss: 0.1661 Validation Accuracy: 0.800200 Epoch 35, CIFAR-10 Batch 1: Loss: 0.2200 Validation Accuracy: 0.795800 Epoch 35, CIFAR-10 Batch 2: Loss: 0.2137 Validation Accuracy: 0.790000 Epoch 35, CIFAR-10 Batch 3: Loss: 0.2249 Validation Accuracy: 0.816000 Epoch 35, CIFAR-10 Batch 4: Loss: 0.2733 Validation Accuracy: 0.802000 Epoch 35, CIFAR-10 Batch 5: Loss: 0.1763 Validation Accuracy: 0.775400 Epoch 36, CIFAR-10 Batch 1: Loss: 0.2267 Validation Accuracy: 0.783600 Epoch 36, CIFAR-10 Batch 2: Loss: 0.2069 Validation Accuracy: 0.821600 Epoch 36, CIFAR-10 Batch 3: Loss: 0.1925 Validation Accuracy: 0.797200 Epoch 36, CIFAR-10 Batch 4: Loss: 0.2463 Validation Accuracy: 0.792200 Epoch 36, CIFAR-10 Batch 5: Loss: 0.1451 Validation Accuracy: 0.806400 Epoch 37, CIFAR-10 Batch 1: Loss: 0.1809 Validation Accuracy: 0.799400 Epoch 37, CIFAR-10 Batch 2: Loss: 0.2063 Validation Accuracy: 0.787800 Epoch 37, CIFAR-10 Batch 3: Loss: 0.2131 Validation Accuracy: 0.825800 Epoch 37, CIFAR-10 Batch 4: Loss: 0.2483 Validation Accuracy: 0.818400 Epoch 37, CIFAR-10 Batch 5: Loss: 0.1448 Validation Accuracy: 0.790000 Epoch 38, CIFAR-10 Batch 1: Loss: 0.1861 Validation Accuracy: 0.799600 Epoch 38, CIFAR-10 Batch 2: Loss: 0.2157 Validation Accuracy: 0.808600 Epoch 38, CIFAR-10 Batch 3: Loss: 0.1966 Validation Accuracy: 0.793200 Epoch 38, CIFAR-10 Batch 4: Loss: 0.2649 Validation Accuracy: 0.829600 Epoch 38, CIFAR-10 Batch 5: Loss: 0.1492 Validation Accuracy: 0.779400 Epoch 39, CIFAR-10 Batch 1: Loss: 0.1683 Validation Accuracy: 0.749400 Epoch 39, CIFAR-10 Batch 2: Loss: 0.2205 Validation Accuracy: 0.803400 Epoch 39, CIFAR-10 Batch 3: Loss: 0.1846 Validation Accuracy: 0.787400 Epoch 39, CIFAR-10 Batch 4: Loss: 0.2232 Validation Accuracy: 0.812800 Epoch 39, CIFAR-10 Batch 5: Loss: 0.1444 Validation Accuracy: 0.807000 Epoch 40, CIFAR-10 Batch 1: Loss: 0.1334 Validation Accuracy: 0.804600 Epoch 40, CIFAR-10 Batch 2: Loss: 0.2045 Validation Accuracy: 0.814400 Epoch 40, CIFAR-10 Batch 3: Loss: 0.1800 Validation Accuracy: 0.821200 Epoch 40, CIFAR-10 Batch 4: Loss: 0.2149 Validation Accuracy: 0.820800 Epoch 40, CIFAR-10 Batch 5: Loss: 0.1238 Validation Accuracy: 0.811600 Epoch 41, CIFAR-10 Batch 1: Loss: 0.1537 Validation Accuracy: 0.780200 Epoch 41, CIFAR-10 Batch 2: Loss: 0.1740 Validation Accuracy: 0.787200 Epoch 41, CIFAR-10 Batch 3: Loss: 0.1815 Validation Accuracy: 0.835000 Epoch 41, CIFAR-10 Batch 4: Loss: 0.2219 Validation Accuracy: 0.808800 Epoch 41, CIFAR-10 Batch 5: Loss: 0.1082 Validation Accuracy: 0.837000 Epoch 42, CIFAR-10 Batch 1: Loss: 0.1725 Validation Accuracy: 0.793200 Epoch 42, CIFAR-10 Batch 2: Loss: 0.1771 Validation Accuracy: 0.813000 Epoch 42, CIFAR-10 Batch 3: Loss: 0.1853 Validation Accuracy: 0.796200 Epoch 42, CIFAR-10 Batch 4: Loss: 0.2046 Validation Accuracy: 0.801000 Epoch 42, CIFAR-10 Batch 5: Loss: 0.1188 Validation Accuracy: 0.810200 Epoch 43, CIFAR-10 Batch 1: Loss: 0.1229 Validation Accuracy: 0.780800 Epoch 43, CIFAR-10 Batch 2: Loss: 0.1639 Validation Accuracy: 0.810200 Epoch 43, CIFAR-10 Batch 3: Loss: 0.1624 Validation Accuracy: 0.827800 Epoch 43, CIFAR-10 Batch 4: Loss: 0.1828 Validation Accuracy: 0.806800 Epoch 43, CIFAR-10 Batch 5: Loss: 0.0978 Validation Accuracy: 0.818000 Epoch 44, CIFAR-10 Batch 1: Loss: 0.1085 Validation Accuracy: 0.792400 Epoch 44, CIFAR-10 Batch 2: Loss: 0.1579 Validation Accuracy: 0.834200 Epoch 44, CIFAR-10 Batch 3: Loss: 0.1774 Validation Accuracy: 0.803800 Epoch 44, CIFAR-10 Batch 4: Loss: 0.1828 Validation Accuracy: 0.829000 Epoch 44, CIFAR-10 Batch 5: Loss: 0.0933 Validation Accuracy: 0.789800 Epoch 45, CIFAR-10 Batch 1: Loss: 0.1186 Validation Accuracy: 0.804800 Epoch 45, CIFAR-10 Batch 2: Loss: 0.1613 Validation Accuracy: 0.825000 Epoch 45, CIFAR-10 Batch 3: Loss: 0.1415 Validation Accuracy: 0.830200 Epoch 45, CIFAR-10 Batch 4: Loss: 0.1775 Validation Accuracy: 0.822600 Epoch 45, CIFAR-10 Batch 5: Loss: 0.0955 Validation Accuracy: 0.829800 Epoch 46, CIFAR-10 Batch 1: Loss: 0.1064 Validation Accuracy: 0.816000 Epoch 46, CIFAR-10 Batch 2: Loss: 0.1609 Validation Accuracy: 0.806600 Epoch 46, CIFAR-10 Batch 3: Loss: 0.1520 Validation Accuracy: 0.813000 Epoch 46, CIFAR-10 Batch 4: Loss: 0.1751 Validation Accuracy: 0.819600 Epoch 46, CIFAR-10 Batch 5: Loss: 0.0927 Validation Accuracy: 0.806600 Epoch 47, CIFAR-10 Batch 1: Loss: 0.1028 Validation Accuracy: 0.801600 Epoch 47, CIFAR-10 Batch 2: Loss: 0.1479 Validation Accuracy: 0.815600 Epoch 47, CIFAR-10 Batch 3: Loss: 0.1282 Validation Accuracy: 0.821800 Epoch 47, CIFAR-10 Batch 4: Loss: 0.1641 Validation Accuracy: 0.839400 Epoch 47, CIFAR-10 Batch 5: Loss: 0.0820 Validation Accuracy: 0.815800 Epoch 48, CIFAR-10 Batch 1: Loss: 0.1329 Validation Accuracy: 0.783600 Epoch 48, CIFAR-10 Batch 2: Loss: 0.1382 Validation Accuracy: 0.824000 Epoch 48, CIFAR-10 Batch 3: Loss: 0.1469 Validation Accuracy: 0.839200 Epoch 48, CIFAR-10 Batch 4: Loss: 0.1701 Validation Accuracy: 0.815400 Epoch 48, CIFAR-10 Batch 5: Loss: 0.0873 Validation Accuracy: 0.824000 Epoch 49, CIFAR-10 Batch 1: Loss: 0.0966 Validation Accuracy: 0.825800 Epoch 49, CIFAR-10 Batch 2: Loss: 0.1471 Validation Accuracy: 0.811800 Epoch 49, CIFAR-10 Batch 3: Loss: 0.1344 Validation Accuracy: 0.823800 Epoch 49, CIFAR-10 Batch 4: Loss: 0.1608 Validation Accuracy: 0.830200 Epoch 49, CIFAR-10 Batch 5: Loss: 0.0795 Validation Accuracy: 0.822800 Epoch 50, CIFAR-10 Batch 1: Loss: 0.1111 Validation Accuracy: 0.797800 Epoch 50, CIFAR-10 Batch 2: Loss: 0.1262 Validation Accuracy: 0.811800 Epoch 50, CIFAR-10 Batch 3: Loss: 0.1125 Validation Accuracy: 0.825600 Epoch 50, CIFAR-10 Batch 4: Loss: 0.1577 Validation Accuracy: 0.828200 Epoch 50, CIFAR-10 Batch 5: Loss: 0.0680 Validation Accuracy: 0.814800 Epoch 51, CIFAR-10 Batch 1: Loss: 0.0882 Validation Accuracy: 0.782000 Epoch 51, CIFAR-10 Batch 2: Loss: 0.1189 Validation Accuracy: 0.826800 Epoch 51, CIFAR-10 Batch 3: Loss: 0.1069 Validation Accuracy: 0.809400 Epoch 51, CIFAR-10 Batch 4: Loss: 0.1528 Validation Accuracy: 0.830400 Epoch 51, CIFAR-10 Batch 5: Loss: 0.0761 Validation Accuracy: 0.802400 Epoch 52, CIFAR-10 Batch 1: Loss: 0.0896 Validation Accuracy: 0.804000 Epoch 52, CIFAR-10 Batch 2: Loss: 0.1174 Validation Accuracy: 0.834600 Epoch 52, CIFAR-10 Batch 3: Loss: 0.0984 Validation Accuracy: 0.818200 Epoch 52, CIFAR-10 Batch 4: Loss: 0.1575 Validation Accuracy: 0.851200 Epoch 52, CIFAR-10 Batch 5: Loss: 0.0709 Validation Accuracy: 0.825200 Epoch 53, CIFAR-10 Batch 1: Loss: 0.0787 Validation Accuracy: 0.806200 Epoch 53, CIFAR-10 Batch 2: Loss: 0.1011 Validation Accuracy: 0.821800 Epoch 53, CIFAR-10 Batch 3: Loss: 0.1061 Validation Accuracy: 0.834000 Epoch 53, CIFAR-10 Batch 4: Loss: 0.1274 Validation Accuracy: 0.821000 Epoch 53, CIFAR-10 Batch 5: Loss: 0.0711 Validation Accuracy: 0.822400 Epoch 54, CIFAR-10 Batch 1: Loss: 0.0800 Validation Accuracy: 0.793000 Epoch 54, CIFAR-10 Batch 2: Loss: 0.1127 Validation Accuracy: 0.831400 Epoch 54, CIFAR-10 Batch 3: Loss: 0.0888 Validation Accuracy: 0.823000 Epoch 54, CIFAR-10 Batch 4: Loss: 0.1232 Validation Accuracy: 0.845000 Epoch 54, CIFAR-10 Batch 5: Loss: 0.0566 Validation Accuracy: 0.850000 Epoch 55, CIFAR-10 Batch 1: Loss: 0.0698 Validation Accuracy: 0.808000 Epoch 55, CIFAR-10 Batch 2: Loss: 0.0977 Validation Accuracy: 0.816800 Epoch 55, CIFAR-10 Batch 3: Loss: 0.0894 Validation Accuracy: 0.800400 Epoch 55, CIFAR-10 Batch 4: Loss: 0.1245 Validation Accuracy: 0.832200 Epoch 55, CIFAR-10 Batch 5: Loss: 0.0610 Validation Accuracy: 0.800400 Epoch 56, CIFAR-10 Batch 1: Loss: 0.0656 Validation Accuracy: 0.802600 Epoch 56, CIFAR-10 Batch 2: Loss: 0.1141 Validation Accuracy: 0.807200 Epoch 56, CIFAR-10 Batch 3: Loss: 0.0936 Validation Accuracy: 0.823200 Epoch 56, CIFAR-10 Batch 4: Loss: 0.1153 Validation Accuracy: 0.840600 Epoch 56, CIFAR-10 Batch 5: Loss: 0.0559 Validation Accuracy: 0.816400 Epoch 57, CIFAR-10 Batch 1: Loss: 0.0629 Validation Accuracy: 0.813200 Epoch 57, CIFAR-10 Batch 2: Loss: 0.0882 Validation Accuracy: 0.830200 Epoch 57, CIFAR-10 Batch 3: Loss: 0.0893 Validation Accuracy: 0.822600 Epoch 57, CIFAR-10 Batch 4: Loss: 0.1309 Validation Accuracy: 0.832000 Epoch 57, CIFAR-10 Batch 5: Loss: 0.0606 Validation Accuracy: 0.821000 Epoch 58, CIFAR-10 Batch 1: Loss: 0.0608 Validation Accuracy: 0.816000 Epoch 58, CIFAR-10 Batch 2: Loss: 0.0941 Validation Accuracy: 0.840800 Epoch 58, CIFAR-10 Batch 3: Loss: 0.0721 Validation Accuracy: 0.815400 Epoch 58, CIFAR-10 Batch 4: Loss: 0.1278 Validation Accuracy: 0.838400 Epoch 58, CIFAR-10 Batch 5: Loss: 0.0573 Validation Accuracy: 0.830000 Epoch 59, CIFAR-10 Batch 1: Loss: 0.0595 Validation Accuracy: 0.798000 Epoch 59, CIFAR-10 Batch 2: Loss: 0.0794 Validation Accuracy: 0.837600 Epoch 59, CIFAR-10 Batch 3: Loss: 0.0854 Validation Accuracy: 0.832000 Epoch 59, CIFAR-10 Batch 4: Loss: 0.1140 Validation Accuracy: 0.842800 Epoch 59, CIFAR-10 Batch 5: Loss: 0.0507 Validation Accuracy: 0.817200 Epoch 60, CIFAR-10 Batch 1: Loss: 0.0649 Validation Accuracy: 0.828200 Epoch 60, CIFAR-10 Batch 2: Loss: 0.0781 Validation Accuracy: 0.841400 Epoch 60, CIFAR-10 Batch 3: Loss: 0.1008 Validation Accuracy: 0.843000 Epoch 60, CIFAR-10 Batch 4: Loss: 0.1237 Validation Accuracy: 0.837000 Epoch 60, CIFAR-10 Batch 5: Loss: 0.0572 Validation Accuracy: 0.808200 Epoch 61, CIFAR-10 Batch 1: Loss: 0.0583 Validation Accuracy: 0.818400 Epoch 61, CIFAR-10 Batch 2: Loss: 0.0821 Validation Accuracy: 0.832600 Epoch 61, CIFAR-10 Batch 3: Loss: 0.0853 Validation Accuracy: 0.828800 Epoch 61, CIFAR-10 Batch 4: Loss: 0.0886 Validation Accuracy: 0.835400 Epoch 61, CIFAR-10 Batch 5: Loss: 0.0527 Validation Accuracy: 0.832400 Epoch 62, CIFAR-10 Batch 1: Loss: 0.0566 Validation Accuracy: 0.832600 Epoch 62, CIFAR-10 Batch 2: Loss: 0.0761 Validation Accuracy: 0.820800 Epoch 62, CIFAR-10 Batch 3: Loss: 0.0746 Validation Accuracy: 0.823800 Epoch 62, CIFAR-10 Batch 4: Loss: 0.0953 Validation Accuracy: 0.833000 Epoch 62, CIFAR-10 Batch 5: Loss: 0.0521 Validation Accuracy: 0.843000 Epoch 63, CIFAR-10 Batch 1: Loss: 0.0489 Validation Accuracy: 0.841600 Epoch 63, CIFAR-10 Batch 2: Loss: 0.0814 Validation Accuracy: 0.808800 Epoch 63, CIFAR-10 Batch 3: Loss: 0.0661 Validation Accuracy: 0.842800 Epoch 63, CIFAR-10 Batch 4: Loss: 0.0781 Validation Accuracy: 0.837600 Epoch 63, CIFAR-10 Batch 5: Loss: 0.0492 Validation Accuracy: 0.822000 Epoch 64, CIFAR-10 Batch 1: Loss: 0.0525 Validation Accuracy: 0.836000 Epoch 64, CIFAR-10 Batch 2: Loss: 0.0897 Validation Accuracy: 0.844200 Epoch 64, CIFAR-10 Batch 3: Loss: 0.0624 Validation Accuracy: 0.836400 Epoch 64, CIFAR-10 Batch 4: Loss: 0.0772 Validation Accuracy: 0.843800 Epoch 64, CIFAR-10 Batch 5: Loss: 0.0525 Validation Accuracy: 0.827600 Epoch 65, CIFAR-10 Batch 1: Loss: 0.0504 Validation Accuracy: 0.847600 Epoch 65, CIFAR-10 Batch 2: Loss: 0.0774 Validation Accuracy: 0.827600 Epoch 65, CIFAR-10 Batch 3: Loss: 0.0608 Validation Accuracy: 0.834400 Epoch 65, CIFAR-10 Batch 4: Loss: 0.0875 Validation Accuracy: 0.822400 Epoch 65, CIFAR-10 Batch 5: Loss: 0.0473 Validation Accuracy: 0.847800 Epoch 66, CIFAR-10 Batch 1: Loss: 0.0487 Validation Accuracy: 0.811800 Epoch 66, CIFAR-10 Batch 2: Loss: 0.0791 Validation Accuracy: 0.844200 Epoch 66, CIFAR-10 Batch 3: Loss: 0.0664 Validation Accuracy: 0.847600 Epoch 66, CIFAR-10 Batch 4: Loss: 0.0806 Validation Accuracy: 0.846000 Epoch 66, CIFAR-10 Batch 5: Loss: 0.0448 Validation Accuracy: 0.832000 Epoch 67, CIFAR-10 Batch 1: Loss: 0.0570 Validation Accuracy: 0.819400 Epoch 67, CIFAR-10 Batch 2: Loss: 0.0640 Validation Accuracy: 0.841600 Epoch 67, CIFAR-10 Batch 3: Loss: 0.0605 Validation Accuracy: 0.821800 Epoch 67, CIFAR-10 Batch 4: Loss: 0.0735 Validation Accuracy: 0.848200 Epoch 67, CIFAR-10 Batch 5: Loss: 0.0434 Validation Accuracy: 0.836000 Epoch 68, CIFAR-10 Batch 1: Loss: 0.0467 Validation Accuracy: 0.847400 Epoch 68, CIFAR-10 Batch 2: Loss: 0.0800 Validation Accuracy: 0.838200 Epoch 68, CIFAR-10 Batch 3: Loss: 0.0618 Validation Accuracy: 0.830000 Epoch 68, CIFAR-10 Batch 4: Loss: 0.0833 Validation Accuracy: 0.855800 Epoch 68, CIFAR-10 Batch 5: Loss: 0.0405 Validation Accuracy: 0.850600 Epoch 69, CIFAR-10 Batch 1: Loss: 0.0429 Validation Accuracy: 0.836200 Epoch 69, CIFAR-10 Batch 2: Loss: 0.0585 Validation Accuracy: 0.831000 Epoch 69, CIFAR-10 Batch 3: Loss: 0.0595 Validation Accuracy: 0.815800 Epoch 69, CIFAR-10 Batch 4: Loss: 0.0720 Validation Accuracy: 0.834800 Epoch 69, CIFAR-10 Batch 5: Loss: 0.0409 Validation Accuracy: 0.852200 Epoch 70, CIFAR-10 Batch 1: Loss: 0.0484 Validation Accuracy: 0.832000 Epoch 70, CIFAR-10 Batch 2: Loss: 0.0706 Validation Accuracy: 0.835800 Epoch 70, CIFAR-10 Batch 3: Loss: 0.0557 Validation Accuracy: 0.855200 Epoch 70, CIFAR-10 Batch 4: Loss: 0.0669 Validation Accuracy: 0.845600 Epoch 70, CIFAR-10 Batch 5: Loss: 0.0402 Validation Accuracy: 0.846200 Epoch 71, CIFAR-10 Batch 1: Loss: 0.0474 Validation Accuracy: 0.824000 Epoch 71, CIFAR-10 Batch 2: Loss: 0.0764 Validation Accuracy: 0.831600 Epoch 71, CIFAR-10 Batch 3: Loss: 0.0597 Validation Accuracy: 0.847400 Epoch 71, CIFAR-10 Batch 4: Loss: 0.0736 Validation Accuracy: 0.857400 Epoch 71, CIFAR-10 Batch 5: Loss: 0.0386 Validation Accuracy: 0.836400 Epoch 72, CIFAR-10 Batch 1: Loss: 0.0439 Validation Accuracy: 0.821800 Epoch 72, CIFAR-10 Batch 2: Loss: 0.0655 Validation Accuracy: 0.838800 Epoch 72, CIFAR-10 Batch 3: Loss: 0.0656 Validation Accuracy: 0.831400 Epoch 72, CIFAR-10 Batch 4: Loss: 0.0684 Validation Accuracy: 0.863800 Epoch 72, CIFAR-10 Batch 5: Loss: 0.0401 Validation Accuracy: 0.824600 Epoch 73, CIFAR-10 Batch 1: Loss: 0.0440 Validation Accuracy: 0.854000 Epoch 73, CIFAR-10 Batch 2: Loss: 0.0747 Validation Accuracy: 0.802800 Epoch 73, CIFAR-10 Batch 3: Loss: 0.0726 Validation Accuracy: 0.838000 Epoch 73, CIFAR-10 Batch 4: Loss: 0.0676 Validation Accuracy: 0.845600 Epoch 73, CIFAR-10 Batch 5: Loss: 0.0440 Validation Accuracy: 0.851400 Epoch 74, CIFAR-10 Batch 1: Loss: 0.0401 Validation Accuracy: 0.838400 Epoch 74, CIFAR-10 Batch 2: Loss: 0.0572 Validation Accuracy: 0.821400 Epoch 74, CIFAR-10 Batch 3: Loss: 0.0557 Validation Accuracy: 0.836200 Epoch 74, CIFAR-10 Batch 4: Loss: 0.0663 Validation Accuracy: 0.850800 Epoch 74, CIFAR-10 Batch 5: Loss: 0.0390 Validation Accuracy: 0.829400 Epoch 75, CIFAR-10 Batch 1: Loss: 0.0439 Validation Accuracy: 0.831000 Epoch 75, CIFAR-10 Batch 2: Loss: 0.0565 Validation Accuracy: 0.861800 Epoch 75, CIFAR-10 Batch 3: Loss: 0.0504 Validation Accuracy: 0.832800 Epoch 75, CIFAR-10 Batch 4: Loss: 0.0648 Validation Accuracy: 0.842800 Epoch 75, CIFAR-10 Batch 5: Loss: 0.0381 Validation Accuracy: 0.831600 Epoch 76, CIFAR-10 Batch 1: Loss: 0.0430 Validation Accuracy: 0.834400 Epoch 76, CIFAR-10 Batch 2: Loss: 0.0587 Validation Accuracy: 0.828800 Epoch 76, CIFAR-10 Batch 3: Loss: 0.0475 Validation Accuracy: 0.822600 Epoch 76, CIFAR-10 Batch 4: Loss: 0.0518 Validation Accuracy: 0.845200 Epoch 76, CIFAR-10 Batch 5: Loss: 0.0385 Validation Accuracy: 0.826800 Epoch 77, CIFAR-10 Batch 1: Loss: 0.0469 Validation Accuracy: 0.842600 Epoch 77, CIFAR-10 Batch 2: Loss: 0.0588 Validation Accuracy: 0.835400 Epoch 77, CIFAR-10 Batch 3: Loss: 0.0540 Validation Accuracy: 0.815200 Epoch 77, CIFAR-10 Batch 4: Loss: 0.0611 Validation Accuracy: 0.825400 Epoch 77, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.852200 Epoch 78, CIFAR-10 Batch 1: Loss: 0.0378 Validation Accuracy: 0.837200 Epoch 78, CIFAR-10 Batch 2: Loss: 0.0568 Validation Accuracy: 0.836200 Epoch 78, CIFAR-10 Batch 3: Loss: 0.0509 Validation Accuracy: 0.847600 Epoch 78, CIFAR-10 Batch 4: Loss: 0.0598 Validation Accuracy: 0.838400 Epoch 78, CIFAR-10 Batch 5: Loss: 0.0398 Validation Accuracy: 0.844200 Epoch 79, CIFAR-10 Batch 1: Loss: 0.0399 Validation Accuracy: 0.865600 Epoch 79, CIFAR-10 Batch 2: Loss: 0.0534 Validation Accuracy: 0.850600 Epoch 79, CIFAR-10 Batch 3: Loss: 0.0481 Validation Accuracy: 0.843600 Epoch 79, CIFAR-10 Batch 4: Loss: 0.0535 Validation Accuracy: 0.857000 Epoch 79, CIFAR-10 Batch 5: Loss: 0.0379 Validation Accuracy: 0.852000 Epoch 80, CIFAR-10 Batch 1: Loss: 0.0434 Validation Accuracy: 0.814000 Epoch 80, CIFAR-10 Batch 2: Loss: 0.0537 Validation Accuracy: 0.833400 Epoch 80, CIFAR-10 Batch 3: Loss: 0.0517 Validation Accuracy: 0.849400 Epoch 80, CIFAR-10 Batch 4: Loss: 0.0543 Validation Accuracy: 0.851400 Epoch 80, CIFAR-10 Batch 5: Loss: 0.0368 Validation Accuracy: 0.853600 Epoch 81, CIFAR-10 Batch 1: Loss: 0.0404 Validation Accuracy: 0.851600 Epoch 81, CIFAR-10 Batch 2: Loss: 0.0569 Validation Accuracy: 0.822600 Epoch 81, CIFAR-10 Batch 3: Loss: 0.0470 Validation Accuracy: 0.845400 Epoch 81, CIFAR-10 Batch 4: Loss: 0.0585 Validation Accuracy: 0.851000 Epoch 81, CIFAR-10 Batch 5: Loss: 0.0396 Validation Accuracy: 0.844200 Epoch 82, CIFAR-10 Batch 1: Loss: 0.0366 Validation Accuracy: 0.870400 Epoch 82, CIFAR-10 Batch 2: Loss: 0.0451 Validation Accuracy: 0.872400 Epoch 82, CIFAR-10 Batch 3: Loss: 0.0485 Validation Accuracy: 0.872400 Epoch 82, CIFAR-10 Batch 4: Loss: 0.0447 Validation Accuracy: 0.875800 Epoch 82, CIFAR-10 Batch 5: Loss: 0.0372 Validation Accuracy: 0.875800 Epoch 83, CIFAR-10 Batch 1: Loss: 0.0360 Validation Accuracy: 0.874000 Epoch 83, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.875400 Epoch 83, CIFAR-10 Batch 3: Loss: 0.0463 Validation Accuracy: 0.872800 Epoch 83, CIFAR-10 Batch 4: Loss: 0.0438 Validation Accuracy: 0.876600 Epoch 83, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875200 Epoch 84, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 84, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 84, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 84, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 84, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 85, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876600 Epoch 85, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 85, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874800 Epoch 85, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 85, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 86, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 86, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 86, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 86, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 86, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 87, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876200 Epoch 87, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 87, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 87, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 87, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 88, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 88, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 88, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 88, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 88, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 89, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 89, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 89, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 89, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 89, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 90, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 90, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.877000 Epoch 90, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 90, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 90, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 91, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 91, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.875800 Epoch 91, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 91, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 91, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 92, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 92, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 92, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 92, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 92, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 93, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 93, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 93, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 93, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.878200 Epoch 93, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 94, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 94, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 94, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 94, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.878000 Epoch 94, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 95, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 95, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 95, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 95, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 95, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 96, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 96, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 96, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874800 Epoch 96, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 96, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 97, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 97, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 97, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 97, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 97, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 98, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 98, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 98, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 98, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 98, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 99, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 99, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 99, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 99, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 99, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 100, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 100, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 100, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 100, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 100, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 101, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 101, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 101, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 101, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 101, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 102, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 102, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 102, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 102, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 102, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 103, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 103, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 103, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 103, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 103, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 104, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 104, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 104, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 104, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 104, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 105, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 105, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 105, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 105, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 105, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 106, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876600 Epoch 106, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 106, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 106, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 106, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 107, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 107, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.877200 Epoch 107, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875800 Epoch 107, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 107, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 108, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876200 Epoch 108, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 108, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 108, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 108, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 109, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 109, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.875800 Epoch 109, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 109, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 109, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 110, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 110, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 110, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 110, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 110, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 111, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876200 Epoch 111, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 111, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875800 Epoch 111, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.878000 Epoch 111, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 112, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 112, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 112, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 112, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 112, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 113, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 113, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 113, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 113, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876400 Epoch 113, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 114, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 114, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 114, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 114, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 114, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 115, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876200 Epoch 115, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 115, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 115, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 115, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 116, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 116, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 116, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.876000 Epoch 116, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 116, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 117, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 117, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 117, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 117, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 117, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 118, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 118, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 118, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 118, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 118, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 119, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 119, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 119, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874800 Epoch 119, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 119, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 120, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 120, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 120, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 120, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 120, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 121, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 121, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 121, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 121, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.878000 Epoch 121, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 122, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 122, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 122, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 122, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 122, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 123, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875200 Epoch 123, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 123, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 123, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 123, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 124, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 124, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 124, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 124, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 124, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 125, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 125, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 125, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 125, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 125, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 126, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 126, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 126, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 126, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 126, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 127, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 127, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.877000 Epoch 127, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 127, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876400 Epoch 127, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875400 Epoch 128, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 128, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 128, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 128, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 128, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 129, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 129, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 129, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 129, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 129, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 130, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 130, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.877200 Epoch 130, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875800 Epoch 130, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 130, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 131, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 131, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 131, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 131, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 131, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 132, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 132, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 132, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 132, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 132, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 133, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876200 Epoch 133, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 133, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 133, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 133, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 134, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 134, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 134, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 134, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 134, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 135, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 135, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 135, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 135, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 135, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 136, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 136, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 136, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 136, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 136, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875600 Epoch 137, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 137, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 137, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 137, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 137, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 138, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 138, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 138, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 138, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876000 Epoch 138, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 139, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 139, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 139, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 139, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 139, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 140, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 140, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 140, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 140, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 140, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 141, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 141, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 141, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 141, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 141, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 142, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 142, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 142, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874800 Epoch 142, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 142, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 143, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 143, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 143, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 143, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 143, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 144, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 144, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.875800 Epoch 144, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 144, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 144, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 145, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 145, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 145, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 145, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 145, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875600 Epoch 146, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 146, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 146, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 146, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 146, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 147, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 147, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 147, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875600 Epoch 147, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 147, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 148, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 148, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 148, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 148, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 148, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 149, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876600 Epoch 149, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 149, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 149, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 149, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 150, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 150, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 150, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 150, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 150, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 151, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 151, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 151, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 151, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 151, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 152, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 152, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 152, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874200 Epoch 152, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 152, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 153, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 153, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 153, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 153, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876800 Epoch 153, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 154, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876400 Epoch 154, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 154, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 154, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 154, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 155, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 155, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 155, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 155, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877200 Epoch 155, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 156, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.876000 Epoch 156, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 156, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874800 Epoch 156, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 156, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 157, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 157, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 157, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875200 Epoch 157, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 157, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 158, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 158, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 158, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 158, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877800 Epoch 158, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876200 Epoch 159, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875800 Epoch 159, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 159, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.874600 Epoch 159, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 159, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875800 Epoch 160, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875400 Epoch 160, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876800 Epoch 160, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 160, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877600 Epoch 160, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600 Epoch 161, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 161, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876200 Epoch 161, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 161, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876600 Epoch 161, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.875600 Epoch 162, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 162, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876400 Epoch 162, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875000 Epoch 162, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877400 Epoch 162, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876000 Epoch 163, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 163, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876000 Epoch 163, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 163, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.876400 Epoch 163, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876400 Epoch 164, CIFAR-10 Batch 1: Loss: 0.0357 Validation Accuracy: 0.875600 Epoch 164, CIFAR-10 Batch 2: Loss: 0.0428 Validation Accuracy: 0.876600 Epoch 164, CIFAR-10 Batch 3: Loss: 0.0461 Validation Accuracy: 0.875400 Epoch 164, CIFAR-10 Batch 4: Loss: 0.0436 Validation Accuracy: 0.877000 Epoch 164, CIFAR-10 Batch 5: Loss: 0.0373 Validation Accuracy: 0.876600
In [26]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
import tensorflow as tf
import pickle
import random
# Set batch size if not already set
learning_rate_init = 0.001
batch_size = 128
try:
if batch_size:
pass
except NameError:
batch_size = 64
save_model_path = './image_classification(learning_rate={:.5f},batch_size={})'.format(learning_rate_init, batch_size)
n_samples = 4
top_n_predictions = 3
def test_model():
"""
Test the saved model against the test dataset
"""
test_features, test_labels = pickle.load(open('preprocess_test.p', mode='rb'))
loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
# Load model
loader = tf.train.import_meta_graph(save_model_path + '.meta')
loader.restore(sess, save_model_path)
# Get Tensors from loaded model
loaded_x = loaded_graph.get_tensor_by_name('inputs/x:0')
loaded_y = loaded_graph.get_tensor_by_name('inputs/y:0')
loaded_keep_prob_1 = loaded_graph.get_tensor_by_name('inputs/keep_prob_1:0')
loaded_keep_prob_2 = loaded_graph.get_tensor_by_name('inputs/keep_prob_2:0')
loaded_logits = loaded_graph.get_tensor_by_name('logits/logits:0')
loaded_acc = loaded_graph.get_tensor_by_name('predictions/accuracy:0')
loaded_is_training = loaded_graph.get_tensor_by_name('inputs/is_training:0')
# Get accuracy in batches for memory limitations
test_batch_acc_total = 0
test_batch_count = 0
for test_feature_batch, test_label_batch in batch_features_labels(test_features, test_labels, batch_size):
test_batch_acc_total += sess.run(
loaded_acc,
feed_dict={loaded_x: test_feature_batch, loaded_y: test_label_batch, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
loaded_is_training:False})
test_batch_count += 1
print('Testing Accuracy: {}\n'.format(test_batch_acc_total/test_batch_count))
# Print Random Samples
random_test_features, random_test_labels = tuple(zip(*random.sample(list(zip(test_features, test_labels)), n_samples)))
random_test_predictions = sess.run(
tf.nn.top_k(tf.nn.softmax(loaded_logits), top_n_predictions),
feed_dict={loaded_x: random_test_features, loaded_y: random_test_labels, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
loaded_is_training:False})
display_image_predictions(random_test_features, random_test_labels, random_test_predictions)
test_model()
INFO:tensorflow:Restoring parameters from ./image_classification(learning_rate=0.00100,batch_size=128) Testing Accuracy: 0.8942840189873418
The following method about running TensorBoards in Google Colab refer to this stackoverflow answer.¶
Get TensorBoard running in the background. (Inspired by this answer.)
In [ ]:
LOG_DIR = '' # set this to your directory of tenosorboard log files, eg.'./tmp/log'
get_ipython().system_raw(
'tensorboard --logdir {} --host 0.0.0.0 --port 6006 &'
.format(LOG_DIR)
)
In [ ]:
! curl http://localhost:6006
Download and unzip ngrok.
In [ ]:
! wget https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-linux-amd64.zip > /dev/null 2>&1
! unzip ngrok-stable-linux-amd64.zip > /dev/null 2>&1
Launch ngrok background process...
In [ ]:
get_ipython().system_raw('./ngrok http 6006 &')
...and retrieve public url. (Source)
In [ ]:
! curl -s http://localhost:4040/api/tunnels | python3 -c \
"import sys, json; print(json.load(sys.stdin)['tunnels'][0]['public_url'])"
If you run against ngrok rate limits, try to use localtunnel instead:
In [ ]:
# Install
! npm install -g localtunnel
In [ ]:
# Tunnel port 6006 (TensorBoard assumed running)
get_ipython().system_raw('lt --port 6006 >> url.txt 2>&1 &')
In [ ]:
# Get url
! cat url.txt
Why 50-80% Accuracy?¶
You might be wondering why you can't get an accuracy any higher. First things first, 50% isn't bad for a simple CNN. Pure guessing would get you 10% accuracy. However, you might notice people are getting scores well above 80%. That's because we haven't taught you all there is to know about neural networks. We still need to cover a few more techniques.
Submitting This Project¶
When submitting this project, make sure to run all the cells before saving the notebook. Save the notebook file as "dlnd_image_classification.ipynb" and save it as a HTML file under "File" -> "Download as". Include the "helper.py" and "problem_unittests.py" files in your submission.
Some ideas
- Initialize weights to very small
- Initialize biases to zeros
Bonus: let accuracy over 90%¶
優化 CNN 的方法¶
- 改善 Gradient Vanishing 問題：
- Xavier Initialization → He Initialization
- Batch Normalization
- Selu (Self-Normalizing ReLU, SNN)
- 讓 Dropout 比例不一：Differential Dropout
- 隨機打亂資料：Random Shuffling
- 考慮模型複雜度的懲罰值：L2 Regularization
- Learning rate decay
- NIN
- Data Augmentation (source code is in another ipython file: final_dlnd_image_classification_with_DA)
NIN (Network in Network) 主要有兩大改進¶
1. Mlpconv (multilayer perceptron convolution)¶
- 在 conv layers 中間加上多層的 fully connected layers。
- 實作上使用 1x1 conv (又稱 cascaded cross-channel pooling, CCCP)。
- 提高 conv layer 的非線性感知能力。
2. Global Average Pooling¶
- 對整個 feature map 取平均值，直接作為output layer的結果。
- 取代 fully connected layers ，大幅減少 parameters 。
使用 Tensorboard 視覺化的結果調整 Hyperparameters¶
1. Choosing Learning Rate¶
I make the learning rate decays over 81 epochs and 122 epochs down to 1/10 of the initial learning rate. So, at about 81th epoch, there is an abrupt increasing!
結果顯示當 learning rate 為 0.001 時，收斂最快，準確率也最高。而 learning rate decay 可以在模型學完粗略的部分之後，以更小的 learning rate 學習更到細膩的部份，可由圖中約 81 epoch 時的突然變化得知的確有效。
2. Choosing Batch Size¶
結果顯示當 batch size 對於模型的準確度影響不大。大的 batch size 因為一次看的資料多，學習穩定，不易產生訓練震盪，且訓練較快，但是比較占記憶體；小的 batch size 每次只看一小批資料，在訓練過程中較不穩定，且較不吃記憶體，卻需較久的時間。
權重分布¶
Data Augmentation¶
我使用 imgaug 這個 python package 做 data augmentation 。
我先將 5 份 batch data (10000 images/batch data) 做 random shuffling 並切出 90% 作為 train batch data (9000 images/train batch data) ，並將 5 份剩下的 10% 集合成 validation data (5000 images/validation data) ，再將 5 份 train batch data 做 data augmentation ，每張 image 擴增 9 份，總共多產生 5 份 augmentation train batch data (81000 images/aug train batch)。
最後將 train batch data 與 augmentation train batch data 合併成 100000 images/batch ，然後隨機切成 10 等份做為新的 train batch data ，餵入模型訓練。
而其中我所使用到的 data augmentation 方法如下表：
產生出的圖片如下所示：
Reference¶
《Network In Network》: https://arxiv.org/pdf/1312.4400.pdf
《Striving For Simplicity：The All Convolutional Net》: https://arxiv.org/pdf/1412.6806.pdf
NIN: https://github.com/BIGBALLON/Deep-learning-and-practices/tree/master/Lab3-NIN
Xavier Initialization: http://andyljones.tumblr.com/post/110998971763/an-explanation-of-xavier-initialization
《Self-Normalizing Neural Networks》: https://arxiv.org/pdf/1706.02515.pdf
